Apr 29 08:59:52 devstack cinder-volume[75310]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 08:59:52 devstack cinder-volume[75310]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 08:59:52 devstack cinder-volume[75310]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 08:59:53 devstack cinder-volume[75310]: INFO dbcounter [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Registered counter for database cinder Apr 29 08:59:53 devstack cinder-volume[75310]: DEBUG oslo_db.sqlalchemy.engines [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:59:53 devstack cinder-volume[75310]: DEBUG dbcounter [-] [75310] Writer thread running {{(pid=75310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 08:59:53 devstack cinder-volume[75310]: INFO cinder.rpc [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 08:59:53 devstack cinder-volume[75310]: INFO cinder.rpc [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 08:59:53 devstack cinder-volume[75310]: DEBUG oslo_db.sqlalchemy.engines [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:59:53 devstack cinder-volume[75310]: INFO cinder.volume.manager [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Determined volume DB was empty at startup. Apr 29 08:59:53 devstack cinder-volume[75310]: DEBUG cinder.volume.manager [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75310) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 08:59:53 devstack cinder-volume[75310]: INFO cinder.volume.manager [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 08:59:53 devstack cinder-volume[75310]: WARNING stevedore.named [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 08:59:53 devstack cinder-volume[75310]: WARNING castellan.key_manager [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:59:53 devstack cinder-volume[75310]: WARNING cinder.keymgr.conf_key_mgr [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:59:53 devstack cinder-volume[75310]: DEBUG cinder.volume.drivers.lvm [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75310) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 08:59:53 devstack cinder-volume[75310]: DEBUG oslo_concurrency.processutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_concurrency.processutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] CMD "cinder-rtstool verify" returned: 0 in 0.362s {{(pid=75310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_db.sqlalchemy.engines [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:59:54 devstack cinder-volume[75310]: INFO cinder.rpc [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 08:59:54 devstack cinder-volume[75310]: INFO cinder.rpc [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 08:59:54 devstack cinder-volume[75310]: WARNING stevedore.named [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 08:59:54 devstack cinder-volume[75310]: WARNING castellan.key_manager [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 08:59:54 devstack cinder-volume[75310]: INFO cinder.volume.manager [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_db.sqlalchemy.engines [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 08:59:54 devstack cinder-volume[75310]: INFO oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Starting 1 workers Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Started child 75478 {{(pid=75310) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Full set of CONF: {{(pid=75310) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] ******************************************************************************** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Configuration options gathered from: {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] ================================================================================ {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] allow_availability_zone_fallback = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] allow_compression_on_image_upload = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] allowed_direct_url_schemes = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] api_rate_limit = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] auth_strategy = keystone {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] az_cache_duration = 3600 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_availability_zone = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_host = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_stats_polling_interval = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backup_api_class = cinder.backup.api.API {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backup_name_template = backup-%s {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backup_use_same_host = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backup_use_temp_snapshot = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] chap_password = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] chap_username = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_internal_tenant_project_id = dff6b23b550f4fdea326aba931593e04 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_internal_tenant_user_id = d101d01b2865451bacc44f9dcb6c34c3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cloned_volume_same_az = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cluster = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] compression_format = gzip {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] compute_api_class = cinder.compute.nova.API {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] config_dir = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] config_source = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] control_exchange = openstack {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] debug = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] default_availability_zone = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] default_group_type = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] default_volume_type = lvmdriver-1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] disk_geometry = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] driver_client_cert = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] driver_client_cert_key = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] driver_data_namespace = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] driver_ssl_cert_path = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] driver_ssl_cert_verify = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] driver_use_ssl = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] enable_force_upload = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] enable_new_services = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] enable_unsupported_driver = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] enforce_multipath_for_image_xfer = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] filter_function = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_api_insecure = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_api_ssl_compression = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_ca_certificates_file = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_catalog_info = image:glance:publicURL {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_num_retries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance_request_timeout = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] goodness_function = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] graceful_shutdown_timeout = 5 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] group_api_class = cinder.group.api.API {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] host = devstack {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_compress_on_upload = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_conversion_address_space_limit = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_conversion_cpu_limit = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_conversion_disable = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_upload_use_cinder_backend = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_upload_use_internal_tenant = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_volume_cache_enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_volume_cache_max_count = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] image_volume_cache_max_size_gb = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] init_host_max_objects_retrieval = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] instance_format = [instance: %(uuid)s] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] iscsi_target_flags = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] iscsi_write_cache = on {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] iser_helper = tgtadm {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] iser_ip_address = 192.168.122.168 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] iser_port = 3260 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_color = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_config_append = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_dir = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_file = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_options = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_rotate_interval = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_rotate_interval_type = days {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] log_rotation_type = none {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] max_age = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] max_logfile_count = 30 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] max_logfile_size_mb = 200 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] max_over_subscription_ratio = 20.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] message_reap_interval = 86400 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] message_ttl = 2592000 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] migration_create_volume_timeout_secs = 300 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] monkey_patch = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] monkey_patch_modules = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] my_ip = 192.168.122.168 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] no_snapshot_gb_quota = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] num_iser_scan_tries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] num_shell_tries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] num_volume_device_scan_tries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] nvmeof_conn_info_version = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] nvmet_ns_id = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] nvmet_port_id = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] osapi_max_limit = 1000 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] osapi_volume_ext_list = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] osapi_volume_listen_port = 8776 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] osapi_volume_use_ssl = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] osapi_volume_workers = 2 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] per_volume_size_limit = -1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] periodic_fuzzy_delay = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] periodic_interval = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] public_endpoint = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] publish_errors = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] quota_backup_gigabytes = 1000 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] quota_backups = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] quota_gigabytes = 1000 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] quota_groups = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] quota_snapshots = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] quota_volumes = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] rate_limit_burst = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] rate_limit_except_level = CRITICAL {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] rate_limit_interval = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] reinit_driver_count = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] replication_device = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] report_discard_supported = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] report_interval = 120 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] reservation_clean_interval = 86400 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] reservation_expire = 86400 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] reserved_image_namespaces = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] reserved_percentage = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] rpc_response_timeout = 120 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] run_external_periodic_tasks = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] scst_target_driver = iscsi {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] scst_target_iqn_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_down_time = 720 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] shell_completion = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] snapshot_name_template = snapshot-%s {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] snapshot_same_host = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] split_loggers = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] state_path = /opt/stack/data/cinder {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] storage_availability_zone = nova {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] storage_protocol = iSCSI {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] syslog_log_facility = LOG_USER {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] target_helper = lioadm {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] target_ip_address = 192.168.122.168 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] target_port = 3260 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] target_protocol = iscsi {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] target_secondary_ip_addresses = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] trace_flags = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] transport_url = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] until_refresh = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] use_chap_auth = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] use_default_quota_class = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] use_journal = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] use_json = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] use_multipath_for_image_xfer = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] use_stderr = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] use_syslog = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] verify_glance_signatures = enabled {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_api_class = cinder.volume.api.API {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_backend_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_clear = zero {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_clear_ionice = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_clear_size = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_copy_bps_limit = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_dd_blocksize = 1M {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_name_template = volume-%s {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_service_inithost_offload = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volume_usage_audit_period = month {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] zoning_mode = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_concurrency.disable_process_locking = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.admin_password = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.admin_token = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.admin_user = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_port = 35357 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_protocol = https {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_section = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_type = password {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_uri = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.auth_version = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.cache = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.identity_uri = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.include_service_catalog = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.insecure = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.interface = public {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_password = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcache_username = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.region_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.service_type = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.backend = dogpile.cache.null {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.backend_argument = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.backend_expiration_time = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.config_prefix = cache.oslo {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.debug_cache_backend = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.enable_retry_client = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.enable_socket_keepalive = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.enforce_fips_mode = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.expiration_time = 600 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.hashclient_retry_attempts = 2 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.memcache_dead_retry = 300 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.memcache_pool_maxsize = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.memcache_sasl_enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack sudo[75490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.password = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.proxies = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.redis_db = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack sudo[75490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.redis_server = localhost:6379 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.retry_attempts = 2 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.retry_delay = 0.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.socket_keepalive_count = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.socket_keepalive_idle = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.socket_keepalive_interval = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.socket_timeout = 1.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.tls_allowed_ciphers = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.tls_cafile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.tls_certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.tls_enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.tls_keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cache.username = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] coordination.backend_url = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.asyncio_connection = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.asyncio_slave_connection = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.backend = sqlalchemy {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.connection = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.connection_debug = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.connection_parameters = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.connection_recycle_time = 3600 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.connection_trace = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.db_inc_retry_interval = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.db_max_retries = 20 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.db_max_retry_interval = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.db_retry_interval = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.max_overflow = 50 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.max_pool_size = 5 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.max_retries = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.mysql_wsrep_sync_wait = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.pool_timeout = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.retry_interval = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.slave_connection = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.sqlite_synchronous = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.synchronous_reader = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] database.use_db_reconnect = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.connection_string = messaging:// {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.es_doc_type = notification {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.es_scroll_size = 10000 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.es_scroll_time = 2m {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.filter_error_trace = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.hmac_keys = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.sentinel_service_name = mymaster {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.socket_timeout = 0.1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.trace_requests = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler.trace_sqlalchemy = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler_jaeger.process_tags = {} {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler_jaeger.service_name_prefix = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] profiler_otlp.service_name_prefix = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.enforce_new_defaults = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: WARNING oslo_config.cfg [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.enforce_scope = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.policy_default_rule = default {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.policy_file = policy.yaml {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] privsep_osbrick.group = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] privsep_osbrick.helper_command = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] privsep_osbrick.user = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_sys_admin.group = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_sys_admin.helper_command = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] cinder_sys_admin.user = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.auth_section = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.auth_type = password {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.cafile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.collect_timing = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.insecure = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.send_service_user_token = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.split_loggers = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] service_user.timeout = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.auth_section = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.auth_type = password {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.collect_timing = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.insecure = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.region_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.split_loggers = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] glance.timeout = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.backend_availability_zone = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.chap_password = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.chap_username = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.disk_geometry = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.driver_client_cert = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.driver_client_cert_key = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.driver_data_namespace = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.driver_use_ssl = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.extra_capabilities = {} {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.filter_function = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.goodness_function = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.iscsi_target_flags = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.iscsi_write_cache = on {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.iser_helper = tgtadm {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.iser_port = 3260 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.lvm_share_target = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.lvm_type = auto {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.num_shell_tries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.replication_device = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.report_discard_supported = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.reserved_percentage = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.target_helper = tgtadm {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.target_port = 3260 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.target_protocol = iscsi {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.trace_flags = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.unique_fqdn_network = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.use_chap_auth = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_backend_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_clear = zero {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_clear_ionice = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_clear_size = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_reports.file_event_handler = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_reports.log_dir = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.backend_host = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.chap_password = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.chap_username = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.disk_geometry = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.driver_client_cert = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.extra_capabilities = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.filter_function = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.goodness_function = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.iser_helper = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.iser_ip_address = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.iser_port = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.lvm_share_target = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.lvm_type = auto {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.num_shell_tries = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.replication_device = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.report_discard_supported = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.reserved_percentage = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.scst_target_driver = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.storage_protocol = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.target_helper = lioadm {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.target_ip_address = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.target_port = 3260 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.trace_flags = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.use_chap_auth = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_clear = zero {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_clear_size = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] lvmdriver-1.volumes_dir = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.ssl = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_notifications.driver = [] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_notifications.retry = -1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] key_manager.fixed_key = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.barbican_api_version = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.barbican_endpoint = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.barbican_endpoint_type = public {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.barbican_region_name = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.cafile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.collect_timing = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.insecure = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.number_of_retries = 60 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.retry_delay = 1 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.send_service_user_token = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.split_loggers = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.timeout = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.verify_ssl = True {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican.verify_ssl_path = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.auth_section = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.auth_type = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.cafile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.certfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.collect_timing = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.insecure = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.keyfile = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.split_loggers = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] barbican_service_user.timeout = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.approle_role_id = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.approle_secret_id = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.kv_mountpoint = secret {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.kv_path = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.kv_version = 2 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.namespace = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.root_token_id = **** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.ssl_ca_crt_file = None {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.timeout = 60.0 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.use_ssl = False {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 08:59:54 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] ******************************************************************************** {{(pid=75310) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 08:59:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:55 devstack sudo[75490]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:55 devstack sudo[75558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:59:55 devstack sudo[75558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:55 devstack sudo[75558]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.759s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 08:59:55 devstack cinder-volume[75478]: INFO cinder.brick.local_dev.lvm [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 08:59:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:56 devstack sudo[75829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:59:56 devstack sudo[75829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:56 devstack sudo[75829]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:56 devstack cinder-volume[75478]: DEBUG cinder.brick.local_dev.lvm [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75478) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 08:59:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:56 devstack sudo[76048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:59:56 devstack sudo[76048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:57 devstack sudo[76048]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.274s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:57 devstack sudo[76230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 08:59:57 devstack sudo[76230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:58 devstack sudo[76230]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:58 devstack sudo[76265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 08:59:58 devstack sudo[76265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 08:59:59 devstack sudo[76265]: pam_unix(sudo:session): session closed for user root Apr 29 08:59:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.998s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 08:59:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 08:59:59 devstack sudo[76275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 08:59:59 devstack sudo[76275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:00 devstack sudo[76275]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:00 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:00 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:00 devstack sudo[76280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 09:00:00 devstack sudo[76280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:00 devstack sudo[76280]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:00 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.595s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:00 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:00 devstack sudo[76283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:00:00 devstack sudo[76283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:01 devstack sudo[76283]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:01 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:01 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:01 devstack sudo[76288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:00:01 devstack sudo[76288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:02 devstack sudo[76288]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:02 devstack sudo[76295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:00:02 devstack sudo[76295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:02 devstack sudo[76295]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:02 devstack cinder-volume[75478]: INFO cinder.volume.drivers.lvm [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:02 devstack sudo[76304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:00:02 devstack sudo[76304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:03 devstack sudo[76304]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:03 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.807s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:03 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 09:00:03 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:03 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 09:00:03 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:04 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:04 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:04 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:04 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:00:04 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:04 devstack cinder-volume[75310]: DEBUG dbcounter [-] [75310] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:00:04 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:04 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:04 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:04 devstack sudo[76565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:00:04 devstack sudo[76565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:05 devstack sudo[76565]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:05 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.601s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:05 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:05 devstack sudo[76571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:00:05 devstack sudo[76571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:06 devstack sudo[76571]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:06 devstack cinder-volume[75478]: INFO cinder.volume.driver [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Driver hasn't implemented _init_vendor_properties() Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG cinder.volume.driver [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75478) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writer thread running {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG cinder.db.sqlalchemy.api [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Building query based on filter {{(pid=75478) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG cinder.image.image_utils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75478) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 09:00:06 devstack cinder-volume[75478]: INFO cinder.keymgr.migration [None req-3ddd333f-15be-4d6b-9112-191d4ddaa6cd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:06 devstack sudo[76575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 09:00:06 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:06 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:06 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:06 devstack sudo[76578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:00:06 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:07 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:07 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:07 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:07 devstack sudo[76581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:00:07 devstack sudo[76581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:07 devstack sudo[76581]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:07 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:07 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:07 devstack sudo[76584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:00:07 devstack sudo[76584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:08 devstack sudo[76584]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:08 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:08 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:00:08 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Driver initialization completed successfully. Apr 29 09:00:08 devstack cinder-volume[75478]: INFO cinder.manager [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Initiating service 2 cleanup Apr 29 09:00:08 devstack cinder-volume[75478]: INFO cinder.manager [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Service 2 cleanup completed. Apr 29 09:00:08 devstack cinder-volume[75478]: DEBUG cinder.service [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Creating RPC server for service cinder-volume {{(pid=75478) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 09:00:08 devstack cinder-volume[75478]: DEBUG cinder.service [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75478) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 09:00:08 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 09:00:08 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 09:00:08 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:08 devstack sudo[76591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 09:00:08 devstack sudo[76591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:09 devstack sudo[76591]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:09 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:09 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:09 devstack sudo[76596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:00:09 devstack sudo[76596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:10 devstack sudo[76596]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:10 devstack sudo[76599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:00:10 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:10 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:00:10 devstack sudo[76656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:00:10 devstack sudo[76656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:00:11 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:00:11 devstack sudo[76656]: pam_unix(sudo:session): session closed for user root Apr 29 09:00:11 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-ec6271ec-e0c0-4653-8271-cf66445bf3ae None None] Driver post RPC initialization completed successfully. Apr 29 09:00:21 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=4 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:00:21 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:01:14 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:01:14 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 09:01:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:14 devstack sudo[78847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 09:01:14 devstack sudo[78847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:14 devstack sudo[78847]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:14 devstack sudo[78850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:01:14 devstack sudo[78850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:15 devstack sudo[78850]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:15 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:15 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:15 devstack sudo[78853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:01:15 devstack sudo[78853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:16 devstack sudo[78853]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.564s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:01:16 devstack sudo[78864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:01:16 devstack sudo[78864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:01:16 devstack sudo[78864]: pam_unix(sudo:session): session closed for user root Apr 29 09:01:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:01:16 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:14 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:02:14 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 09:02:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:14 devstack sudo[81739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 09:02:14 devstack sudo[81739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:15 devstack sudo[81739]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:15 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:15 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:15 devstack sudo[81746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:02:15 devstack sudo[81746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:15 devstack sudo[81746]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:15 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:15 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:15 devstack sudo[81749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 09:02:15 devstack sudo[81749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:16 devstack sudo[81749]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:02:16 devstack sudo[81753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 09:02:16 devstack sudo[81753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:02:16 devstack sudo[81753]: pam_unix(sudo:session): session closed for user root Apr 29 09:02:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:02:16 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-c8eb9af5-b910-4d53-8bfd-2da014c3ccad None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:02:21 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:02:21 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:02:56 devstack cinder-volume[75310]: INFO oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Caught SIGTERM, stopping children Apr 29 09:02:56 devstack cinder-volume[75310]: DEBUG oslo_concurrency.lockutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Acquiring lock "singleton_lock" {{(pid=75310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 09:02:56 devstack cinder-volume[75310]: DEBUG oslo_concurrency.lockutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Acquired lock "singleton_lock" {{(pid=75310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 09:02:56 devstack cinder-volume[75310]: DEBUG oslo_concurrency.lockutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Releasing lock "singleton_lock" {{(pid=75310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 09:02:56 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Stop services. {{(pid=75310) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 09:02:56 devstack cinder-volume[75310]: DEBUG oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Killing children. {{(pid=75310) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 09:02:56 devstack cinder-volume[75310]: INFO oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Waiting on 1 children to exit Apr 29 09:02:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Acquiring lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 09:02:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Acquired lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 09:02:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Releasing lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 09:02:58 devstack cinder-volume[75478]: WARNING amqp [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 09:02:58 devstack cinder-volume[75478]: WARNING amqp [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 09:02:58 devstack cinder-volume[75310]: INFO oslo_service.backend._eventlet.service [None req-28e4bb20-cc01-4567-8932-8f8b7c968d21 None None] Child 75478 exited with status 0 Apr 29 09:03:01 devstack cinder-volume[83130]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 09:03:01 devstack cinder-volume[83130]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 09:03:01 devstack cinder-volume[83130]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 09:03:01 devstack cinder-volume[83130]: INFO dbcounter [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Registered counter for database cinder Apr 29 09:03:01 devstack cinder-volume[83130]: DEBUG oslo_db.sqlalchemy.engines [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG dbcounter [-] [83130] Writer thread running {{(pid=83130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 09:03:02 devstack cinder-volume[83130]: INFO cinder.rpc [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 09:03:02 devstack cinder-volume[83130]: INFO cinder.rpc [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_db.sqlalchemy.engines [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:02 devstack cinder-volume[83130]: INFO cinder.volume.manager [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Determined volume DB was empty at startup. Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG cinder.volume.manager [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83130) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 09:03:02 devstack cinder-volume[83130]: INFO cinder.volume.manager [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 09:03:02 devstack cinder-volume[83130]: WARNING stevedore.named [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 09:03:02 devstack cinder-volume[83130]: WARNING castellan.key_manager [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 09:03:02 devstack cinder-volume[83130]: WARNING cinder.keymgr.conf_key_mgr [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 09:03:02 devstack cinder-volume[83130]: INFO cinder.volume.manager [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_db.sqlalchemy.engines [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:02 devstack cinder-volume[83130]: INFO oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Starting 1 workers Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Started child 83410 {{(pid=83130) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Full set of CONF: {{(pid=83130) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] ******************************************************************************** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Configuration options gathered from: {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] ================================================================================ {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] allow_availability_zone_fallback = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] allow_compression_on_image_upload = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] allowed_direct_url_schemes = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83410]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] api_rate_limit = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] auth_strategy = keystone {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_availability_zone = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_host = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_stats_polling_interval = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backup_api_class = cinder.backup.api.API {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backup_name_template = backup-%s {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backup_use_same_host = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backup_use_temp_snapshot = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] chap_password = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] chap_username = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_internal_tenant_project_id = dff6b23b550f4fdea326aba931593e04 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_internal_tenant_user_id = d101d01b2865451bacc44f9dcb6c34c3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cluster = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] compression_format = gzip {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] compute_api_class = cinder.compute.nova.API {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] config_dir = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] config_source = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] control_exchange = openstack {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] debug = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] default_availability_zone = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] default_group_type = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] default_volume_type = QuobyteHD {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] disk_geometry = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] driver_client_cert = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] driver_client_cert_key = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] driver_data_namespace = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] driver_ssl_cert_path = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] driver_ssl_cert_verify = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] driver_use_ssl = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] enable_new_services = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] enable_unsupported_driver = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] enabled_backends = ['QuobyteHD'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] enforce_multipath_for_image_xfer = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] filter_function = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_api_insecure = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_api_ssl_compression = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_ca_certificates_file = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_catalog_info = image:glance:publicURL {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_num_retries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance_request_timeout = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] goodness_function = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] graceful_shutdown_timeout = 5 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] group_api_class = cinder.group.api.API {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] host = devstack {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_compress_on_upload = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_conversion_address_space_limit = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_conversion_cpu_limit = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_conversion_disable = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_upload_use_cinder_backend = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_upload_use_internal_tenant = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_volume_cache_enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_volume_cache_max_count = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] image_volume_cache_max_size_gb = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] init_host_max_objects_retrieval = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] instance_format = [instance: %(uuid)s] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] iscsi_target_flags = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] iscsi_write_cache = on {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] iser_helper = tgtadm {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] iser_ip_address = 192.168.122.168 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] iser_port = 3260 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_color = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_config_append = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_dir = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_file = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_options = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_rotate_interval = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83410]: INFO cinder.volume.manager [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_rotate_interval_type = days {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] log_rotation_type = none {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] max_age = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] max_logfile_count = 30 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] max_logfile_size_mb = 200 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] max_over_subscription_ratio = 20.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] message_reap_interval = 86400 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] message_ttl = 2592000 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] migration_create_volume_timeout_secs = 300 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] monkey_patch = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] monkey_patch_modules = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] my_ip = 192.168.122.168 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] no_snapshot_gb_quota = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] num_iser_scan_tries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] num_shell_tries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] num_volume_device_scan_tries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] nvmeof_conn_info_version = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.remotefs [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83410) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] nvmet_ns_id = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] nvmet_port_id = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] osapi_max_limit = 1000 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] osapi_volume_ext_list = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] osapi_volume_listen_port = 8776 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] osapi_volume_use_ssl = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] osapi_volume_workers = 2 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] per_volume_size_limit = -1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] periodic_fuzzy_delay = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] periodic_interval = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] public_endpoint = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] publish_errors = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] quota_backup_gigabytes = 1000 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] quota_backups = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] quota_gigabytes = 1000 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] quota_groups = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] quota_snapshots = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] quota_volumes = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] rate_limit_burst = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] rate_limit_except_level = CRITICAL {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] rate_limit_interval = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] reinit_driver_count = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] replication_device = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] report_discard_supported = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] report_interval = 120 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] reservation_clean_interval = 86400 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] reservation_expire = 86400 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] reserved_image_namespaces = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] reserved_percentage = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] rpc_response_timeout = 120 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] run_external_periodic_tasks = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] scst_target_driver = iscsi {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] scst_target_iqn_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_down_time = 720 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] shell_completion = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] snapshot_name_template = snapshot-%s {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] split_loggers = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] state_path = /opt/stack/data/cinder {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] storage_availability_zone = nova {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] storage_protocol = iSCSI {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] syslog_log_facility = LOG_USER {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] target_helper = lioadm {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] target_ip_address = 192.168.122.168 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] target_port = 3260 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] target_protocol = iscsi {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] target_secondary_ip_addresses = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] trace_flags = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] transport_url = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] until_refresh = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] use_chap_auth = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] use_default_quota_class = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] use_journal = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] use_json = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] use_multipath_for_image_xfer = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] use_stderr = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] use_syslog = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] verify_glance_signatures = enabled {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_api_class = cinder.volume.api.API {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_backend_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_clear = zero {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_clear_ionice = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_clear_size = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_copy_bps_limit = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_dd_blocksize = 1M {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_name_template = volume-%s {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_service_inithost_offload = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volume_usage_audit_period = month {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] zoning_mode = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_concurrency.disable_process_locking = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.admin_password = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.admin_token = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.admin_user = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_port = 35357 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_protocol = https {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_section = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_type = password {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_uri = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.auth_version = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.cache = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.identity_uri = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.include_service_catalog = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.insecure = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.interface = public {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_password = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcache_username = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.region_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.service_type = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83410) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 09:03:02 devstack cinder-volume[83410]: WARNING cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 09:03:02 devstack cinder-volume[83410]: WARNING cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 09:03:02 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Running cmd (subprocess): mount.quobyte {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.backend = dogpile.cache.null {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.backend_argument = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.backend_expiration_time = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.config_prefix = cache.oslo {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.debug_cache_backend = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.enable_retry_client = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.enable_socket_keepalive = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.enforce_fips_mode = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.expiration_time = 600 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.hashclient_retry_attempts = 2 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.memcache_dead_retry = 300 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.memcache_pool_maxsize = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.memcache_sasl_enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.password = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.proxies = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.redis_db = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.redis_server = localhost:6379 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.retry_attempts = 2 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.retry_delay = 0.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.socket_keepalive_count = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.socket_keepalive_idle = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.socket_keepalive_interval = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.socket_timeout = 1.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.tls_allowed_ciphers = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.tls_cafile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.tls_certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.tls_enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.tls_keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cache.username = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] coordination.backend_url = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.asyncio_connection = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.asyncio_slave_connection = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.backend = sqlalchemy {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.connection = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.connection_debug = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.connection_parameters = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.connection_recycle_time = 3600 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.connection_trace = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.db_inc_retry_interval = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.db_max_retries = 20 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.db_max_retry_interval = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.db_retry_interval = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.max_overflow = 50 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.max_pool_size = 5 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.max_retries = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.mysql_wsrep_sync_wait = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.pool_timeout = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.retry_interval = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.slave_connection = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.sqlite_synchronous = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.synchronous_reader = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:02 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] database.use_db_reconnect = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.connection_string = messaging:// {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.es_doc_type = notification {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.es_scroll_size = 10000 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.es_scroll_time = 2m {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.filter_error_trace = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.hmac_keys = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.sentinel_service_name = mymaster {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.socket_timeout = 0.1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.trace_requests = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler.trace_sqlalchemy = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler_jaeger.process_tags = {} {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler_jaeger.service_name_prefix = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] profiler_otlp.service_name_prefix = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.enforce_new_defaults = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: WARNING oslo_config.cfg [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.enforce_scope = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.policy_default_rule = default {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.policy_file = policy.yaml {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] privsep_osbrick.group = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] privsep_osbrick.helper_command = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] privsep_osbrick.user = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_sys_admin.group = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_sys_admin.helper_command = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] cinder_sys_admin.user = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.auth_section = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.auth_type = password {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.cafile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.collect_timing = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.insecure = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.send_service_user_token = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.split_loggers = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] service_user.timeout = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.auth_section = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.auth_type = password {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.collect_timing = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.insecure = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.region_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.split_loggers = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] glance.timeout = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.backend_availability_zone = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.chap_password = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.chap_username = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.disk_geometry = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.driver_client_cert = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.driver_client_cert_key = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.driver_data_namespace = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.driver_use_ssl = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.extra_capabilities = {} {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.filter_function = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.goodness_function = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.iscsi_target_flags = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.iscsi_write_cache = on {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.iser_helper = tgtadm {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.iser_port = 3260 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_host = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_login = admin {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_mount_options = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_password = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_private_key = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_share_path = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack quobyte-client[83424]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 09:03:03 devstack quobyte-client[83424]: Invalid parameters found, error: missing mount point. Apr 29 09:03:03 devstack quobyte-client[83424]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 09:03:03 devstack quobyte-client[83424]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.num_shell_tries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=83410) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.quobyte_volume_url = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.replication_device = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.report_discard_supported = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.reserved_percentage = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83410]: INFO cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce ... Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 -c /etc/quobyte/client-cinder.cfg {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.target_helper = tgtadm {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.target_port = 3260 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.target_protocol = iscsi {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.trace_flags = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.unique_fqdn_network = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.use_chap_auth = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_backend_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_clear = zero {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_clear_ionice = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_clear_size = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_reports.file_event_handler = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_reports.log_dir = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.backend_availability_zone = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.backend_host = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.chap_password = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.chap_username = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.chiscsi_conf = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.disk_geometry = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.driver_client_cert = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.driver_data_namespace = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.driver_use_ssl = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.extra_capabilities = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.filter_function = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.goodness_function = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack sudo[83426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 -c /etc/quobyte/client-cinder.cfg Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack sudo[83426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.iser_helper = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.iser_ip_address = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.iser_port = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.iser_target_prefix = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_host = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_login = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_mount_options = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_password = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_private_key = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_share_path = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_ssh_port = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.num_shell_tries = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.nvmet_port_id = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.replication_device = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.report_discard_supported = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.reserved_percentage = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.scst_target_driver = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.storage_protocol = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.target_helper = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.target_ip_address = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.target_port = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.target_prefix = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.target_protocol = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.trace_flags = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.use_chap_auth = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_clear = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_clear_size = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] QuobyteHD.volumes_dir = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.ssl = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_notifications.driver = [] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_notifications.retry = -1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] key_manager.fixed_key = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.barbican_api_version = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.barbican_endpoint = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.barbican_endpoint_type = public {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.barbican_region_name = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.cafile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.collect_timing = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.insecure = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.number_of_retries = 60 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.retry_delay = 1 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.send_service_user_token = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.split_loggers = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.timeout = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.verify_ssl = True {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican.verify_ssl_path = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.auth_section = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.auth_type = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.cafile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.certfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.collect_timing = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.insecure = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.keyfile = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.split_loggers = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] barbican_service_user.timeout = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.approle_role_id = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.approle_secret_id = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.kv_mountpoint = secret {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.kv_path = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.kv_version = 2 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.namespace = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.root_token_id = **** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.ssl_ca_crt_file = None {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.timeout = 60.0 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.use_ssl = False {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:03 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] ******************************************************************************** {{(pid=83130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 09:03:03 devstack sudo[83426]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.811s {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:03 devstack cinder-volume[83410]: INFO cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce succeeded Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=83410) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.825s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:03 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:03 devstack sudo[83514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:03:03 devstack sudo[83514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:04 devstack sudo[83514]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.595s {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:04 devstack cinder-volume[83410]: INFO cinder.volume.driver [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG cinder.volume.driver [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6306228637695, 'free_capacity_gb': 1775.6306228637695, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83410) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG oslo_db.sqlalchemy.engines [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG dbcounter [-] [83410] Writer thread running {{(pid=83410) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG cinder.db.sqlalchemy.api [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Building query based on filter {{(pid=83410) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG cinder.image.image_utils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83410) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 09:03:04 devstack cinder-volume[83410]: INFO cinder.keymgr.migration [None req-b5333540-3b1d-4a50-b870-a614c3e20e26 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=83410) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=83410) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:04 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:04 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:03:04 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:05 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.604s {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG cinder.manager [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Notifying Schedulers of capabilities ... {{(pid=83410) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:05 devstack cinder-volume[83410]: INFO cinder.volume.manager [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Driver initialization completed successfully. Apr 29 09:03:05 devstack cinder-volume[83410]: INFO cinder.manager [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Initiating service 3 cleanup Apr 29 09:03:05 devstack cinder-volume[83410]: INFO cinder.manager [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Service 3 cleanup completed. Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG cinder.service [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Creating RPC server for service cinder-volume {{(pid=83410) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG cinder.service [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83410) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 09:03:05 devstack cinder-volume[83410]: INFO cinder.volume.manager [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=83410) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=83410) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:05 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:05 devstack sudo[83559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:03:05 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:06 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:06 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.627s {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:06 devstack cinder-volume[83410]: INFO cinder.volume.manager [None req-5e71f05f-b5b2-49b1-8314-e7a59c3120b1 None None] Driver post RPC initialization completed successfully. Apr 29 09:03:09 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:09 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:09 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=83410) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:09 devstack cinder-volume[83410]: DEBUG cinder.volume.drivers.quobyte [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=83410) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:09 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83410) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:09 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:09 devstack sudo[83674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:03:09 devstack sudo[83674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:10 devstack sudo[83674]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:10 devstack cinder-volume[83410]: DEBUG oslo_concurrency.processutils [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.569s {{(pid=83410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:10 devstack cinder-volume[83410]: DEBUG cinder.manager [None req-1ef840ab-fe91-45c6-b3c9-d7b22c379d6d None None] Notifying Schedulers of capabilities ... {{(pid=83410) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:10 devstack cinder-volume[83130]: INFO oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Caught SIGTERM, stopping children Apr 29 09:03:10 devstack cinder-volume[83130]: DEBUG oslo_concurrency.lockutils [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Acquiring lock "singleton_lock" {{(pid=83130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 09:03:10 devstack cinder-volume[83130]: DEBUG oslo_concurrency.lockutils [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Acquired lock "singleton_lock" {{(pid=83130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 09:03:10 devstack cinder-volume[83130]: DEBUG oslo_concurrency.lockutils [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Releasing lock "singleton_lock" {{(pid=83130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 09:03:10 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Stop services. {{(pid=83130) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 09:03:10 devstack cinder-volume[83130]: DEBUG oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Killing children. {{(pid=83130) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 09:03:10 devstack cinder-volume[83130]: INFO oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Waiting on 1 children to exit Apr 29 09:03:13 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Acquiring lock "singleton_lock" {{(pid=83410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 09:03:13 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Acquired lock "singleton_lock" {{(pid=83410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 09:03:13 devstack cinder-volume[83410]: DEBUG oslo_concurrency.lockutils [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Releasing lock "singleton_lock" {{(pid=83410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 09:03:13 devstack cinder-volume[83410]: WARNING amqp [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 09:03:13 devstack cinder-volume[83410]: WARNING amqp [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 09:03:13 devstack cinder-volume[83130]: INFO oslo_service.backend._eventlet.service [None req-9d979ce2-afdc-4da3-a174-9feb3f8967d8 None None] Child 83410 exited with status 0 Apr 29 09:03:16 devstack cinder-volume[83743]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 09:03:16 devstack cinder-volume[83743]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 09:03:16 devstack cinder-volume[83743]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 09:03:17 devstack cinder-volume[83743]: INFO dbcounter [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Registered counter for database cinder Apr 29 09:03:17 devstack cinder-volume[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG dbcounter [-] [83743] Writer thread running {{(pid=83743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 09:03:18 devstack cinder-volume[83743]: INFO cinder.rpc [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 09:03:18 devstack cinder-volume[83743]: INFO cinder.rpc [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:18 devstack cinder-volume[83743]: INFO cinder.volume.manager [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Determined volume DB was empty at startup. Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG cinder.volume.manager [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83743) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 09:03:18 devstack cinder-volume[83743]: WARNING stevedore.named [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 09:03:18 devstack cinder-volume[83743]: WARNING castellan.key_manager [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 09:03:18 devstack cinder-volume[83743]: WARNING cinder.keymgr.conf_key_mgr [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 09:03:18 devstack cinder-volume[83743]: INFO cinder.volume.manager [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_db.sqlalchemy.engines [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:18 devstack cinder-volume[83743]: INFO oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Starting 1 workers Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Started child 84004 {{(pid=83743) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Full set of CONF: {{(pid=83743) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] ******************************************************************************** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Configuration options gathered from: {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] ================================================================================ {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] allow_availability_zone_fallback = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] allow_compression_on_image_upload = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] allowed_direct_url_schemes = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] api_rate_limit = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] auth_strategy = keystone {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_availability_zone = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_host = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_stats_polling_interval = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[84004]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backup_api_class = cinder.backup.api.API {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backup_name_template = backup-%s {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backup_use_same_host = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backup_use_temp_snapshot = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] chap_password = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] chap_username = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_internal_tenant_project_id = dff6b23b550f4fdea326aba931593e04 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_internal_tenant_user_id = d101d01b2865451bacc44f9dcb6c34c3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cluster = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] compression_format = gzip {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] compute_api_class = cinder.compute.nova.API {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] config_dir = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] config_source = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] control_exchange = openstack {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] debug = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] default_availability_zone = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] default_group_type = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] default_volume_type = QuobyteHD {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] disk_geometry = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] driver_client_cert = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] driver_client_cert_key = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] driver_data_namespace = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] driver_ssl_cert_path = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] driver_ssl_cert_verify = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] driver_use_ssl = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] enable_new_services = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] enable_unsupported_driver = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] enabled_backends = ['QuobyteHD'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] enforce_multipath_for_image_xfer = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] filter_function = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_api_insecure = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_api_ssl_compression = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_ca_certificates_file = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_catalog_info = image:glance:publicURL {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_num_retries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance_request_timeout = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] goodness_function = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] graceful_shutdown_timeout = 5 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] group_api_class = cinder.group.api.API {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] host = devstack {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_compress_on_upload = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_conversion_address_space_limit = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_conversion_cpu_limit = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_conversion_disable = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_upload_use_cinder_backend = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_upload_use_internal_tenant = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_volume_cache_enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_volume_cache_max_count = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] image_volume_cache_max_size_gb = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] init_host_max_objects_retrieval = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] instance_format = [instance: %(uuid)s] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] iscsi_target_flags = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] iscsi_write_cache = on {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] iser_helper = tgtadm {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] iser_ip_address = 192.168.122.168 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] iser_port = 3260 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_color = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_config_append = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_dir = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_file = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_options = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_rotate_interval = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_rotate_interval_type = days {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] log_rotation_type = none {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] max_age = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] max_logfile_count = 30 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] max_logfile_size_mb = 200 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] max_over_subscription_ratio = 20.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] message_reap_interval = 86400 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] message_ttl = 2592000 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] migration_create_volume_timeout_secs = 300 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] monkey_patch = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] monkey_patch_modules = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] my_ip = 192.168.122.168 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] no_snapshot_gb_quota = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] num_iser_scan_tries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] num_shell_tries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] num_volume_device_scan_tries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] nvmeof_conn_info_version = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] nvmet_ns_id = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] nvmet_port_id = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] osapi_max_limit = 1000 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] osapi_volume_ext_list = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] osapi_volume_listen_port = 8776 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] osapi_volume_use_ssl = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] osapi_volume_workers = 2 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] per_volume_size_limit = -1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] periodic_fuzzy_delay = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] periodic_interval = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] public_endpoint = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] publish_errors = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] quota_backup_gigabytes = 1000 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] quota_backups = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] quota_gigabytes = 1000 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] quota_groups = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] quota_snapshots = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] quota_volumes = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] rate_limit_burst = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] rate_limit_except_level = CRITICAL {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] rate_limit_interval = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] reinit_driver_count = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] replication_device = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] report_discard_supported = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] report_interval = 120 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] reservation_clean_interval = 86400 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] reservation_expire = 86400 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] reserved_image_namespaces = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] reserved_percentage = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] rpc_response_timeout = 120 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 09:03:18 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] run_external_periodic_tasks = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84004) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] scst_target_driver = iscsi {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] scst_target_iqn_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_down_time = 720 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] shell_completion = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] snapshot_name_template = snapshot-%s {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] split_loggers = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] state_path = /opt/stack/data/cinder {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] storage_availability_zone = nova {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] storage_protocol = iSCSI {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] syslog_log_facility = LOG_USER {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] target_helper = lioadm {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] target_ip_address = 192.168.122.168 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] target_port = 3260 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] target_protocol = iscsi {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] target_secondary_ip_addresses = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] trace_flags = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] transport_url = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] until_refresh = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] use_chap_auth = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] use_default_quota_class = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] use_journal = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] use_json = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] use_multipath_for_image_xfer = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] use_stderr = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] use_syslog = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] verify_glance_signatures = enabled {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_api_class = cinder.volume.api.API {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_backend_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_clear = zero {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_clear_ionice = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_clear_size = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_copy_bps_limit = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_dd_blocksize = 1M {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_name_template = volume-%s {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_service_inithost_offload = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volume_usage_audit_period = month {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] zoning_mode = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_concurrency.disable_process_locking = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.admin_password = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.admin_token = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.admin_user = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_port = 35357 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_protocol = https {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_section = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_type = password {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_uri = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.auth_version = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.cache = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.identity_uri = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.include_service_catalog = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.insecure = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.interface = public {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_password = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcache_username = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.region_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.service_type = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.backend = dogpile.cache.null {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.backend_argument = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.backend_expiration_time = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.config_prefix = cache.oslo {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.debug_cache_backend = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.enable_retry_client = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.enable_socket_keepalive = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.enforce_fips_mode = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.expiration_time = 600 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.hashclient_retry_attempts = 2 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.memcache_dead_retry = 300 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.memcache_pool_maxsize = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.memcache_sasl_enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.password = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.proxies = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.redis_db = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.redis_server = localhost:6379 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.retry_attempts = 2 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.retry_delay = 0.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.socket_keepalive_count = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.socket_keepalive_idle = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.socket_keepalive_interval = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.socket_timeout = 1.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.tls_allowed_ciphers = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.tls_cafile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.tls_certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.tls_enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.tls_keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cache.username = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] coordination.backend_url = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.asyncio_connection = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.asyncio_slave_connection = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.backend = sqlalchemy {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.connection = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.connection_debug = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.connection_parameters = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.connection_recycle_time = 3600 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.connection_trace = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.db_inc_retry_interval = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.db_max_retries = 20 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.db_max_retry_interval = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.db_retry_interval = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.max_overflow = 50 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.max_pool_size = 5 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.max_retries = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.mysql_wsrep_sync_wait = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.pool_timeout = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.retry_interval = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.slave_connection = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.sqlite_synchronous = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.synchronous_reader = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] database.use_db_reconnect = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.connection_string = messaging:// {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.es_doc_type = notification {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.es_scroll_size = 10000 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.es_scroll_time = 2m {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.filter_error_trace = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.hmac_keys = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.sentinel_service_name = mymaster {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.socket_timeout = 0.1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.trace_requests = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler.trace_sqlalchemy = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler_jaeger.process_tags = {} {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler_jaeger.service_name_prefix = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] profiler_otlp.service_name_prefix = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.enforce_new_defaults = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: WARNING oslo_config.cfg [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.enforce_scope = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.policy_default_rule = default {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.policy_file = policy.yaml {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] privsep_osbrick.group = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] privsep_osbrick.helper_command = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] privsep_osbrick.user = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_sys_admin.group = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_sys_admin.helper_command = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] cinder_sys_admin.user = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.auth_section = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.auth_type = password {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.cafile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.collect_timing = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.insecure = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.send_service_user_token = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.split_loggers = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] service_user.timeout = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.auth_section = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.auth_type = password {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.collect_timing = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.insecure = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.region_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.split_loggers = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] glance.timeout = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.backend_availability_zone = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.chap_password = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84004) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 09:03:18 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.chap_username = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.disk_geometry = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.driver_client_cert = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.driver_client_cert_key = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.driver_data_namespace = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.driver_use_ssl = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.extra_capabilities = {} {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.filter_function = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Running cmd (subprocess): mount.quobyte {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.goodness_function = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.iscsi_target_flags = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.iscsi_write_cache = on {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.iser_helper = tgtadm {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.iser_port = 3260 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_host = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_login = admin {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_mount_options = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_password = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_private_key = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_share_path = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.num_shell_tries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.quobyte_volume_url = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.replication_device = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.report_discard_supported = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.reserved_percentage = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.target_helper = tgtadm {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.target_port = 3260 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.target_protocol = iscsi {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.trace_flags = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.unique_fqdn_network = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.use_chap_auth = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_backend_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_clear = zero {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_clear_ionice = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_clear_size = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_reports.file_event_handler = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_reports.log_dir = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.backend_availability_zone = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.backend_host = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.chap_password = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.chap_username = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.chiscsi_conf = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.disk_geometry = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.driver_client_cert = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.driver_data_namespace = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.driver_use_ssl = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.extra_capabilities = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.filter_function = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.goodness_function = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.iser_helper = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.iser_ip_address = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.iser_port = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.iser_target_prefix = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_host = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_login = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_mount_options = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_password = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_private_key = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_share_path = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_ssh_port = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.num_shell_tries = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.nvmet_port_id = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.replication_device = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.report_discard_supported = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.reserved_percentage = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.scst_target_driver = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.storage_protocol = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.target_helper = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.target_ip_address = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.target_port = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.target_prefix = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.target_protocol = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.trace_flags = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.use_chap_auth = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_clear = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_clear_size = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] QuobyteHD.volumes_dir = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.ssl = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_notifications.driver = [] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_notifications.retry = -1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] key_manager.fixed_key = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.barbican_api_version = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.barbican_endpoint = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.barbican_endpoint_type = public {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.barbican_region_name = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.cafile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.collect_timing = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.insecure = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.number_of_retries = 60 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.retry_delay = 1 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.send_service_user_token = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.split_loggers = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.timeout = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.verify_ssl = True {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican.verify_ssl_path = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.auth_section = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.auth_type = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.cafile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.certfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.collect_timing = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.insecure = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.keyfile = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.split_loggers = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] barbican_service_user.timeout = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.approle_role_id = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.approle_secret_id = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.kv_mountpoint = secret {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.kv_path = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.kv_version = 2 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.namespace = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.root_token_id = **** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.ssl_ca_crt_file = None {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.timeout = 60.0 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.use_ssl = False {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 09:03:18 devstack cinder-volume[83743]: DEBUG oslo_service.backend._eventlet.service [None req-61835947-2ed5-47f8-b0f1-f1571620ad56 None None] ******************************************************************************** {{(pid=83743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:19 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.542s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:19 devstack cinder-volume[84004]: INFO cinder.volume.driver [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.volume.driver [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6153602600098, 'free_capacity_gb': 1775.6153602600098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84004) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_db.sqlalchemy.engines [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writer thread running {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.db.sqlalchemy.api [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Building query based on filter {{(pid=84004) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84004) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:19 devstack cinder-volume[84004]: INFO cinder.keymgr.migration [None req-b9fd3cd6-bd9c-45e6-bab2-9c0d54b99a62 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 09:03:19 devstack sudo[84010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:03:19 devstack sudo[84010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:19 devstack sudo[84010]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.555s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:03:19 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Driver initialization completed successfully. Apr 29 09:03:19 devstack cinder-volume[84004]: INFO cinder.manager [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Initiating service 3 cleanup Apr 29 09:03:19 devstack cinder-volume[84004]: INFO cinder.manager [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Service 3 cleanup completed. Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.service [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Creating RPC server for service cinder-volume {{(pid=84004) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.service [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84004) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 09:03:19 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:03:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:03:19 devstack sudo[84015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:03:19 devstack sudo[84015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:03:20 devstack sudo[84015]: pam_unix(sudo:session): session closed for user root Apr 29 09:03:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.553s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:03:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-524eaa50-803f-4221-a9e7-0f49d6760461 None None] Driver post RPC initialization completed successfully. Apr 29 09:03:28 devstack cinder-volume[83743]: DEBUG dbcounter [-] [83743] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:03:29 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:03:30 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=2 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Flow 'volume_create_manager' (00a6ee42-8631-4a33-b40a-e4992702b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b2a275-450c-460c-bd95-94a5162384ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b2a275-450c-460c-bd95-94a5162384ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-511688827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07140388-a3fd-48b4-b838-564a1c9fbbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f957a797f504206ba9944655d5a87bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:33Z,use_quota=True,user_id='66990245fc9f4fe4bb5e01fe8705cad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381ad742-609d-4b6c-8d4d-6380efdf90d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381ad742-609d-4b6c-8d4d-6380efdf90d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33914f2f-00fb-492b-951c-0630512e0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33914f2f-00fb-492b-951c-0630512e0f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07140388-a3fd-48b4-b838-564a1c9fbbef', 'volume_name': 'volume-07140388-a3fd-48b4-b838-564a1c9fbbef', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c6bff7-d535-483a-b534-882a92fed1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c6bff7-d535-483a-b534-882a92fed1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2460f233-ccf4-4216-b466-7ffb602c0c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:32 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Volume 07140388-a3fd-48b4-b838-564a1c9fbbef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07140388-a3fd-48b4-b838-564a1c9fbbef', 'volume_size': 1} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-511688827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07140388-a3fd-48b4-b838-564a1c9fbbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f957a797f504206ba9944655d5a87bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:33Z,use_quota=True,user_id='66990245fc9f4fe4bb5e01fe8705cad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Creating volume 07140388-a3fd-48b4-b838-564a1c9fbbef {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:04:32 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:04:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:33 devstack sudo[84445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef 1073741824 Apr 29 09:04:33 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:35 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef 1073741824" returned: 0 in 2.963s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:36 devstack sudo[84792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef Apr 29 09:04:36 devstack sudo[84792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:37 devstack sudo[84792]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef" returned: 0 in 1.638s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] <== create_volume: return (4757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:04:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.759s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2460f233-ccf4-4216-b466-7ffb602c0c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07140388-a3fd-48b4-b838-564a1c9fbbef', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1fe51b-5de0-4d7f-8058-30351c7f9882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:37 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Volume volume-07140388-a3fd-48b4-b838-564a1c9fbbef (07140388-a3fd-48b4-b838-564a1c9fbbef): created successfully Apr 29 09:04:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1fe51b-5de0-4d7f-8058-30351c7f9882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Flow 'volume_create_manager' (00a6ee42-8631-4a33-b40a-e4992702b14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e6c775e3-cafb-452d-ac74-b0fd143d501e tempest-DeleteServersTestJSON-1640998416 None] Created volume successfully. Apr 29 09:04:39 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Flow 'volume_create_manager' (cd41905c-4e08-4e7c-8759-1a46a7eed56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a6c321-4739-4417-9dfe-b4fd579d61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a6c321-4739-4417-9dfe-b4fd579d61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1534463639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908fbef5-00d9-4f3a-97ef-065202c723f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d88d3a60fe644c581c55fb78ccf1736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:40Z,use_quota=True,user_id='be10fae956ec4aed8dc73b4d1ef92977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da76c4-75a6-48b6-b4a4-8f2e8b9cd75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da76c4-75a6-48b6-b4a4-8f2e8b9cd75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9784f-57f4-4147-b6e7-c6ec32af62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb9784f-57f4-4147-b6e7-c6ec32af62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908fbef5-00d9-4f3a-97ef-065202c723f3', 'volume_name': 'volume-908fbef5-00d9-4f3a-97ef-065202c723f3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395fccd2-7ce0-45c8-b43a-b73cd900a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395fccd2-7ce0-45c8-b43a-b73cd900a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382cbaa1-24d2-463a-ba36-2972e1023342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:40 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Volume 908fbef5-00d9-4f3a-97ef-065202c723f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908fbef5-00d9-4f3a-97ef-065202c723f3', 'volume_size': 1} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1534463639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908fbef5-00d9-4f3a-97ef-065202c723f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d88d3a60fe644c581c55fb78ccf1736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:04:40Z,use_quota=True,user_id='be10fae956ec4aed8dc73b4d1ef92977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Creating volume 908fbef5-00d9-4f3a-97ef-065202c723f3 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:04:40 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:04:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:40 devstack sudo[84876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 1073741824 Apr 29 09:04:40 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:41 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 1073741824" returned: 0 in 1.647s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:41 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 Apr 29 09:04:41 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:43 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3" returned: 0 in 1.287s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] <== create_volume: return (3046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:04:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.053s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382cbaa1-24d2-463a-ba36-2972e1023342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908fbef5-00d9-4f3a-97ef-065202c723f3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904d36a9-80bc-4d5d-8e25-55b15e7eac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:04:43 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Volume volume-908fbef5-00d9-4f3a-97ef-065202c723f3 (908fbef5-00d9-4f3a-97ef-065202c723f3): created successfully Apr 29 09:04:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904d36a9-80bc-4d5d-8e25-55b15e7eac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:04:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Flow 'volume_create_manager' (cd41905c-4e08-4e7c-8759-1a46a7eed56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:04:43 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d3d576b6-7d6b-41ab-a114-8571becbdc5e tempest-VolumesAdminNegativeTest-1040861958 None] Created volume successfully. Apr 29 09:04:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Acquiring lock "cinder-908fbef5-00d9-4f3a-97ef-065202c723f3-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Lock "cinder-908fbef5-00d9-4f3a-97ef-065202c723f3-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Acquiring lock "cinder-quobyte-908fbef5-00d9-4f3a-97ef-065202c723f3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:04:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Lock "cinder-quobyte-908fbef5-00d9-4f3a-97ef-065202c723f3" acquired by "delete_volume" :: waited 0.055s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:04:44 devstack cinder-volume[84004]: INFO oslo.privsep.daemon [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfgitdwn7/privsep.sock'] Apr 29 09:04:44 devstack sudo[84929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfgitdwn7/privsep.sock Apr 29 09:04:44 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:48 devstack cinder-volume[84004]: WARNING py.warnings [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 29 09:04:48 devstack cinder-volume[84004]: .first() Apr 29 09:04:48 devstack cinder-volume[84004]: Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:48 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:48 devstack cinder-volume[84004]: INFO oslo.privsep.daemon [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Spawned new privsep daemon via rootwrap Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Accepted privsep connection to /tmp/tmpfgitdwn7/privsep.sock {{(pid=84004) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 09:04:48 devstack cinder-volume[84004]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 09:04:48 devstack cinder-volume[84004]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 09:04:48 devstack cinder-volume[84004]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 09:04:48 devstack cinder-volume[84004]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84972 Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21f2e03-ed66-43b5-ac6b-be7adc0d0462]: (2,) {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:48 devstack cinder-volume[84004]: WARNING oslo_privsep.priv_context [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] privsep daemon already running Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c57b5-6ee0-41eb-83c0-505c0facf87e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e543d8-214a-4ef7-ab6f-d65cf1211475]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:49 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 Apr 29 09:04:49 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:49 devstack sudo[84976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef Apr 29 09:04:49 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:50 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3" returned: 0 in 1.914s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:50 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:50 devstack sudo[85027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3 Apr 29 09:04:50 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef" returned: 0 in 1.994s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.544s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce', 'name': 'volume-07140388-a3fd-48b4-b838-564a1c9fbbef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9e5e486-bb43-407d-b692-5ce6596819dc', 'enforce_multipath': True} {{(pid=84004) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 09:04:51 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-56eb0ed1-0ce6-4801-9470-ead29fbe3edb req-233895b1-6df4-43c3-a9bd-64e1515edd94 tempest-DeleteServersTestJSON-1640998416 None] attachment_update completed successfully. Apr 29 09:04:52 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-908fbef5-00d9-4f3a-97ef-065202c723f3" returned: 0 in 1.437s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Lock "cinder-quobyte-908fbef5-00d9-4f3a-97ef-065202c723f3" released by "delete_volume" :: held 7.496s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:04:52 devstack cinder-volume[84004]: WARNING cinder.quota [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:04:52 devstack cinder-volume[84004]: WARNING cinder.quota [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Created reservations ['e03fc7e9-91d3-4589-95e2-48e9d15388d7', 'e09a3af6-d531-43db-a5a5-b2322329030f', '66c9bc17-9593-4486-8ce6-329a0fc1c327', '6fca40e6-7469-488e-8fa1-b7611437d497'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:04:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:04:52 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:04:52 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:04:54 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Apr 29 09:04:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.524s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:04:54 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:04:54 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Deleted volume successfully. Apr 29 09:04:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f2c914c0-13ea-42bf-b199-ef101ecc3924 tempest-VolumesAdminNegativeTest-1040861958 None] Lock "cinder-908fbef5-00d9-4f3a-97ef-065202c723f3-delete_volume" released by "delete_volume" :: held 9.510s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=15,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:02 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:05:02 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:03 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.808s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:04 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:05:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-e0bf530d-b3a7-40e8-bc9c-1f4afd29daa1 req-81ecfcb8-124e-4258-9772-83eba044eb18 tempest-DeleteServersTestJSON-1640998416 None] Terminate volume connection completed successfully. Apr 29 09:05:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-e0bf530d-b3a7-40e8-bc9c-1f4afd29daa1 req-81ecfcb8-124e-4258-9772-83eba044eb18 tempest-DeleteServersTestJSON-1640998416 None] Deleting attachment f9e5e486-bb43-407d-b692-5ce6596819dc. {{(pid=84004) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 09:05:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Acquiring lock "cinder-07140388-a3fd-48b4-b838-564a1c9fbbef-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Lock "cinder-07140388-a3fd-48b4-b838-564a1c9fbbef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Acquiring lock "cinder-quobyte-07140388-a3fd-48b4-b838-564a1c9fbbef" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Lock "cinder-quobyte-07140388-a3fd-48b4-b838-564a1c9fbbef" acquired by "delete_volume" :: waited 0.035s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:10 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e175a52-8fb6-4d20-a3e8-c6d05e1cefdb]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:10 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef Apr 29 09:05:10 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:11 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef" returned: 0 in 0.962s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:11 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef Apr 29 09:05:11 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:12 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07140388-a3fd-48b4-b838-564a1c9fbbef" returned: 0 in 0.818s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Lock "cinder-quobyte-07140388-a3fd-48b4-b838-564a1c9fbbef" released by "delete_volume" :: held 1.837s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Created reservations ['9f337e5a-2162-4ea9-9c0b-5e3f29262697', 'e63b8ac9-9262-4595-865c-5fc953d58e13', '80524671-992e-43f0-9e3c-dbd076a4180f', '9cbbde71-aaf2-4919-9507-7e4b3a6b468a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:12 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:05:12 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:13 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.687s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:13 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Deleted volume successfully. Apr 29 09:05:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-98a10488-2749-43c9-99c0-1593f4105e33 tempest-DeleteServersTestJSON-1640998416 None] Lock "cinder-07140388-a3fd-48b4-b838-564a1c9fbbef-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Flow 'volume_create_manager' (d2071282-cd21-4684-b3ce-a79f05dd2aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b456a60-0f37-4a0f-8d22-913b07be267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b456a60-0f37-4a0f-8d22-913b07be267f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1487201294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fce376-9b71-4486-8eb5-818f469d494d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78f9da73ea24e5fac323195d3d910ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:16Z,use_quota=True,user_id='12149dc4d3c7474d931b60dcf779341b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd17dc5-b16d-4f07-a524-e845eb36ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd17dc5-b16d-4f07-a524-e845eb36ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a344822-4e9a-426e-b471-6036da83a2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a344822-4e9a-426e-b471-6036da83a2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fce376-9b71-4486-8eb5-818f469d494d', 'volume_name': 'volume-94fce376-9b71-4486-8eb5-818f469d494d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff427d0a-ac56-4617-9cef-9b77296aa086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff427d0a-ac56-4617-9cef-9b77296aa086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7873e93-2739-4fd0-8f60-dc6c599ed6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:16 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Volume 94fce376-9b71-4486-8eb5-818f469d494d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fce376-9b71-4486-8eb5-818f469d494d', 'volume_size': 1} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1487201294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fce376-9b71-4486-8eb5-818f469d494d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78f9da73ea24e5fac323195d3d910ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:16Z,use_quota=True,user_id='12149dc4d3c7474d931b60dcf779341b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Creating volume 94fce376-9b71-4486-8eb5-818f469d494d {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:16 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:05:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:16 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d 1073741824 Apr 29 09:05:16 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:17 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d 1073741824" returned: 0 in 1.217s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:17 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d Apr 29 09:05:17 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:18 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d" returned: 0 in 0.686s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7873e93-2739-4fd0-8f60-dc6c599ed6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fce376-9b71-4486-8eb5-818f469d494d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf847f4-6328-4385-b812-9f4cb680987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:18 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Volume volume-94fce376-9b71-4486-8eb5-818f469d494d (94fce376-9b71-4486-8eb5-818f469d494d): created successfully Apr 29 09:05:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf847f4-6328-4385-b812-9f4cb680987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Flow 'volume_create_manager' (d2071282-cd21-4684-b3ce-a79f05dd2aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-07ceb092-ecfc-4cde-bc56-a2360c3acd15 tempest-ServersNegativeTestJSON-841006202 None] Created volume successfully. Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Flow 'volume_create_manager' (899dae69-1dbc-4fbe-a2d3-cb9c615906e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1c41be-fd03-475b-8938-f3d30f621976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1c41be-fd03-475b-8938-f3d30f621976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1044910546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00d84f0-3059-4d7c-b136-1c732e07d2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78f9da73ea24e5fac323195d3d910ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:23Z,use_quota=True,user_id='12149dc4d3c7474d931b60dcf779341b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b732c6a8-0615-4ffe-b08b-e90c31ae1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b732c6a8-0615-4ffe-b08b-e90c31ae1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da448f1b-1345-4e55-81cf-3b936ecb0412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da448f1b-1345-4e55-81cf-3b936ecb0412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00d84f0-3059-4d7c-b136-1c732e07d2a7', 'volume_name': 'volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86695e13-eb1a-4c10-8144-8192012db862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86695e13-eb1a-4c10-8144-8192012db862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4d1887-08b0-45ae-a9b7-68a47c80d2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:22 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Volume b00d84f0-3059-4d7c-b136-1c732e07d2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7', 'volume_size': 1} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1044910546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00d84f0-3059-4d7c-b136-1c732e07d2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78f9da73ea24e5fac323195d3d910ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:23Z,use_quota=True,user_id='12149dc4d3c7474d931b60dcf779341b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Creating volume b00d84f0-3059-4d7c-b136-1c732e07d2a7 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:22 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:05:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:22 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 1073741824 Apr 29 09:05:22 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:23 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 1073741824" returned: 0 in 1.040s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:23 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 Apr 29 09:05:23 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:24 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7" returned: 0 in 0.779s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4d1887-08b0-45ae-a9b7-68a47c80d2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5459c48-2c15-40dc-a005-61aeb305b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:24 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Volume volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 (b00d84f0-3059-4d7c-b136-1c732e07d2a7): created successfully Apr 29 09:05:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5459c48-2c15-40dc-a005-61aeb305b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Flow 'volume_create_manager' (899dae69-1dbc-4fbe-a2d3-cb9c615906e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:24 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a1049f19-719e-4064-bbd0-263bc914290a tempest-ServersNegativeTestJSON-841006202 None] Created volume successfully. Apr 29 09:05:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "cinder-b00d84f0-3059-4d7c-b136-1c732e07d2a7-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-b00d84f0-3059-4d7c-b136-1c732e07d2a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "cinder-quobyte-b00d84f0-3059-4d7c-b136-1c732e07d2a7" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-quobyte-b00d84f0-3059-4d7c-b136-1c732e07d2a7" acquired by "delete_volume" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:26 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f245c50f-3a0a-48d2-9fe2-7cb371155bed]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:26 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 Apr 29 09:05:26 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-44f09c12-68d5-4f23-b144-8e988baeed62 tempest-GroupsV314Test-78619260 None] Group tempest-GroupsV314Test-Group-829056647: creating Apr 29 09:05:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-44f09c12-68d5-4f23-b144-8e988baeed62 tempest-GroupsV314Test-78619260 None] Group tempest-GroupsV314Test-Group-829056647: created successfully Apr 29 09:05:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-44f09c12-68d5-4f23-b144-8e988baeed62 tempest-GroupsV314Test-78619260 None] Create group completed successfully. Apr 29 09:05:27 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7" returned: 0 in 0.944s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:27 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7 Apr 29 09:05:27 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Flow 'volume_create_manager' (d439a7b2-c6d6-46aa-8877-d4345923b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d07c5cc-1148-410a-b081-99628cb5f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:29 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b00d84f0-3059-4d7c-b136-1c732e07d2a7" returned: 0 in 1.621s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d07c5cc-1148-410a-b081-99628cb5f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1527157721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=891ef1c7-4faf-468d-97b9-8b9baa73edd1,host='devstack@QuobyteHD#QuobyteHD',id=64720732-9c30-439f-8235-532a29038fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e0c2a9de34410eb3a14f0434071e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:29Z,use_quota=True,user_id='490204e3380341a4b220eb86f7f93e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a2548f-ec7f-4dd3-ae81-b43274a9f696),volume_type_id=d3a2548f-ec7f-4dd3-ae81-b43274a9f696)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3394e40b-0711-469e-807c-d16120e7d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3394e40b-0711-469e-807c-d16120e7d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a594f68-e4c9-4e6d-8044-145df4bf65ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a594f68-e4c9-4e6d-8044-145df4bf65ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64720732-9c30-439f-8235-532a29038fc5', 'volume_name': 'volume-64720732-9c30-439f-8235-532a29038fc5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4388b7d9-69c6-4639-9134-f31b73d94751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4388b7d9-69c6-4639-9134-f31b73d94751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e42aba-2252-4cac-a241-b604ddb45537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Volume 64720732-9c30-439f-8235-532a29038fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64720732-9c30-439f-8235-532a29038fc5', 'volume_size': 1} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=891ef1c7-4faf-468d-97b9-8b9baa73edd1,created_at=2026-04-29T07:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1527157721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=891ef1c7-4faf-468d-97b9-8b9baa73edd1,host='devstack@QuobyteHD#QuobyteHD',id=64720732-9c30-439f-8235-532a29038fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e0c2a9de34410eb3a14f0434071e83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:29Z,use_quota=True,user_id='490204e3380341a4b220eb86f7f93e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a2548f-ec7f-4dd3-ae81-b43274a9f696),volume_type_id=d3a2548f-ec7f-4dd3-ae81-b43274a9f696)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Creating volume 64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:05:29 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-quobyte-b00d84f0-3059-4d7c-b136-1c732e07d2a7" released by "delete_volume" :: held 2.750s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:29 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 1073741824 Apr 29 09:05:29 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Created reservations ['f748aa15-374a-4333-bb93-97274ab72ead', 'af8e4869-1b46-48c6-ae74-30e9e12cf975', '5c058247-6571-488b-b32f-a81304021163', '22c4dc56-719e-4506-894d-efb48287814a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:29 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:05:29 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "cinder-94fce376-9b71-4486-8eb5-818f469d494d-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-94fce376-9b71-4486-8eb5-818f469d494d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "cinder-quobyte-94fce376-9b71-4486-8eb5-818f469d494d" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-quobyte-94fce376-9b71-4486-8eb5-818f469d494d" acquired by "delete_volume" :: waited 0.045s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae7059-1da7-4c5d-bd96-626b0e609c4c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:30 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.086s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:30 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d Apr 29 09:05:30 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Deleted volume successfully. Apr 29 09:05:30 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdc11908-57f0-4eb9-84c5-0c752e4cb3cf tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-b00d84f0-3059-4d7c-b136-1c732e07d2a7-delete_volume" released by "delete_volume" :: held 4.397s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:31 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 1073741824" returned: 0 in 2.476s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:31 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 Apr 29 09:05:31 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:31 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d" returned: 0 in 1.510s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:32 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d Apr 29 09:05:32 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:33 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-94fce376-9b71-4486-8eb5-818f469d494d" returned: 0 in 1.320s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-quobyte-94fce376-9b71-4486-8eb5-818f469d494d" released by "delete_volume" :: held 2.943s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:33 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5" returned: 0 in 1.677s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] <== create_volume: return (4219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.223s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Created reservations ['a0c4f082-24c1-4959-b27d-6b3c4ac76fed', '3242d36f-8d40-46e7-9af3-7469bd95815d', '51eb4092-e1c6-4cb9-bcf7-8593bdae111a', '47f972cf-7a0d-4e18-9c6a-d6dcf3229714'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e42aba-2252-4cac-a241-b604ddb45537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64720732-9c30-439f-8235-532a29038fc5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87baede1-4b76-45c1-a18c-c036a3129e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:33 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Volume volume-64720732-9c30-439f-8235-532a29038fc5 (64720732-9c30-439f-8235-532a29038fc5): created successfully Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87baede1-4b76-45c1-a18c-c036a3129e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Flow 'volume_create_manager' (d439a7b2-c6d6-46aa-8877-d4345923b82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b0f5ad99-b40c-4782-962e-922d3ebfca02 tempest-GroupsV314Test-78619260 None] Created volume successfully. Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:33 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:05:33 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:35 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 2.150s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:35 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:05:35 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Deleted volume successfully. Apr 29 09:05:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09331b49-9038-4b4b-ab06-ec7771033e71 tempest-ServersNegativeTestJSON-841006202 None] Lock "cinder-94fce376-9b71-4486-8eb5-818f469d494d-delete_volume" released by "delete_volume" :: held 5.797s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:37 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Cloning volume 64720732-9c30-439f-8235-532a29038fc5 to volume 55030873-59d4-4eb0-9452-5646b185ec88 Apr 29 09:05:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Creating offline snapshot 162bd018-b84e-4fe5-befd-1a41a4f0754e of volume 64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:05:37 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e450509-c8d3-4a43-83b5-a55c30e6ab3b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:37 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 Apr 29 09:05:37 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:38 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5" returned: 0 in 1.192s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:38 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e 1G Apr 29 09:05:38 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:40 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e 1G" returned: 0 in 1.901s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64720732-9c30-439f-8235-532a29038fc5 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:40 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64720732-9c30-439f-8235-532a29038fc5 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e Apr 29 09:05:40 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:42 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64720732-9c30-439f-8235-532a29038fc5 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e" returned: 0 in 1.429s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:42 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:05:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:42 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e Apr 29 09:05:42 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:43 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e" returned: 0 in 0.992s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:43 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.info Apr 29 09:05:43 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:44 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.info" returned: 0 in 1.002s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:44 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:05:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:44 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.info Apr 29 09:05:44 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:44 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.info" returned: 0 in 0.827s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Acquiring lock "cinder-quobyte-55030873-59d4-4eb0-9452-5646b185ec88" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-55030873-59d4-4eb0-9452-5646b185ec88" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] snapshot: 162bd018-b84e-4fe5-befd-1a41a4f0754e, volume: 55030873-59d4-4eb0-9452-5646b185ec88, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a943cbb7-b57a-4ba6-bd8b-ba2d7215f0be]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:45 devstack sudo[85997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e Apr 29 09:05:45 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:45 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e" returned: 0 in 0.871s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64720732-9c30-439f-8235-532a29038fc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa83fd90-a275-4efa-a836-6bd7124c589a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:46 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 Apr 29 09:05:46 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:47 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5" returned: 0 in 1.096s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:47 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:05:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:47 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 Apr 29 09:05:47 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:53 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=31,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:05:53 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:05:54 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88" returned: 0 in 7.657s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:54 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa658b-1548-40a0-885b-7396e5c1431b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:54 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 Apr 29 09:05:54 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:56 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5" returned: 0 in 1.554s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:56 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:05:56 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Converted 1024.00 MB image at 133.71 MB/s Apr 29 09:05:56 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:05:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:56 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 Apr 29 09:05:56 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:57 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88" returned: 0 in 1.306s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-55030873-59d4-4eb0-9452-5646b185ec88" released by "_copy_volume_from_snapshot" :: held 12.627s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Acquiring lock "cinder-quobyte-162bd018-b84e-4fe5-befd-1a41a4f0754e" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-162bd018-b84e-4fe5-befd-1a41a4f0754e" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Deleting offline snapshot 162bd018-b84e-4fe5-befd-1a41a4f0754e of volume 64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] snapshot_file for this snap is: volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ee69f0-8858-456c-8c0a-792fc4309dd7]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:58 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e Apr 29 09:05:58 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:58 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 29 09:05:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e" returned: 0 in 1.143s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:05:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64720732-9c30-439f-8235-532a29038fc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[263e8c75-bf52-4ecf-8094-6d3da9ec5df6]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:05:59 devstack sudo[86162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 Apr 29 09:05:59 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Flow 'volume_create_manager' (3987bf7b-bab8-4894-9bd1-48d2fbd3f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562144de-f4e1-44fb-82be-792b86473c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562144de-f4e1-44fb-82be-792b86473c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-842802662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f759af-7286-4857-9500-61bbf8f97288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f18800f11984ff78f5a085d5de00096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:59Z,use_quota=True,user_id='b1777dc03a0c481a8efb2b76400cf655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c5e037-3b62-40c0-9fc8-26b09fc90e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c5e037-3b62-40c0-9fc8-26b09fc90e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f400de82-2c25-44dc-b0aa-83a5014d8a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f400de82-2c25-44dc-b0aa-83a5014d8a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f759af-7286-4857-9500-61bbf8f97288', 'volume_name': 'volume-16f759af-7286-4857-9500-61bbf8f97288', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9b1d3d-7f1b-4d0a-acca-ba5e3368f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9b1d3d-7f1b-4d0a-acca-ba5e3368f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979423e9-a952-4750-b3cc-5907f208f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:05:59 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Volume 16f759af-7286-4857-9500-61bbf8f97288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f759af-7286-4857-9500-61bbf8f97288', 'volume_size': 1} Apr 29 09:05:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:00 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5" returned: 0 in 0.976s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:00 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e Apr 29 09:06:00 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:00 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e" returned: 0 in 0.771s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:00 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e Apr 29 09:06:00 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:01 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5.162bd018-b84e-4fe5-befd-1a41a4f0754e" returned: 0 in 0.976s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-162bd018-b84e-4fe5-befd-1a41a4f0754e" released by "_delete_snapshot" :: held 4.116s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.645s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-842802662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f759af-7286-4857-9500-61bbf8f97288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f18800f11984ff78f5a085d5de00096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:59Z,use_quota=True,user_id='b1777dc03a0c481a8efb2b76400cf655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Creating volume 16f759af-7286-4857-9500-61bbf8f97288 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:01 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:06:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:01 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 1073741824 Apr 29 09:06:01 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-408727ff-14c0-4365-8e85-6d63203d1a37 tempest-GroupsV314Test-78619260 None] Create group from source-group-891ef1c7-4faf-468d-97b9-8b9baa73edd1 completed successfully. Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:06:02 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:06:02 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Flow 'volume_create_manager' (44be311b-43af-4e49-846f-39b482fe30b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8de565-2f06-4db6-8f1d-1bfa589d8021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8de565-2f06-4db6-8f1d-1bfa589d8021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-196566087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c2ad9b-0399-49bf-b52a-0996b95df023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb32f420996433e8dbca02914592eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:02Z,use_quota=True,user_id='926bee1a1c064911a3d883f5941f7ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215cada0-c4e1-4c8a-bf3f-a97bbf03359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215cada0-c4e1-4c8a-bf3f-a97bbf03359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53692507-44ae-4c7c-9326-3e6c35958eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53692507-44ae-4c7c-9326-3e6c35958eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c2ad9b-0399-49bf-b52a-0996b95df023', 'volume_name': 'volume-14c2ad9b-0399-49bf-b52a-0996b95df023', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c5f688-9b14-4259-82db-380d0e78d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c5f688-9b14-4259-82db-380d0e78d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde9d7f7-4788-48d6-b47d-2e8d3a3dd4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:03 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Volume 14c2ad9b-0399-49bf-b52a-0996b95df023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c2ad9b-0399-49bf-b52a-0996b95df023', 'volume_size': 1} Apr 29 09:06:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:03 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 1073741824" returned: 0 in 1.822s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:03 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 Apr 29 09:06:03 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Acquiring lock "cinder-quobyte-55030873-59d4-4eb0-9452-5646b185ec88" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-55030873-59d4-4eb0-9452-5646b185ec88" acquired by "delete_volume" :: waited 0.044s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:04 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab34a62-b8ef-4aad-8bff-a759157e6a13]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:04 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.779s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:04 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:04 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 Apr 29 09:06:04 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:05 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288" returned: 0 in 1.390s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] <== create_volume: return (3378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.387s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:05 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.242s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-196566087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c2ad9b-0399-49bf-b52a-0996b95df023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fb32f420996433e8dbca02914592eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:02Z,use_quota=True,user_id='926bee1a1c064911a3d883f5941f7ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Creating volume 14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:05 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88" returned: 0 in 1.129s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979423e9-a952-4750-b3cc-5907f208f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f759af-7286-4857-9500-61bbf8f97288', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2803a118-e7a8-4f28-8c5a-a1c63bee98c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:05 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 1073741824 Apr 29 09:06:05 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:05 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88 Apr 29 09:06:05 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:05 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Volume volume-16f759af-7286-4857-9500-61bbf8f97288 (16f759af-7286-4857-9500-61bbf8f97288): created successfully Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2803a118-e7a8-4f28-8c5a-a1c63bee98c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Flow 'volume_create_manager' (3987bf7b-bab8-4894-9bd1-48d2fbd3f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fc82dccd-244c-4df3-ac40-a9d259056aa9 tempest-ServerRescueNegativeTestJSON-1386955919 None] Created volume successfully. Apr 29 09:06:06 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 1073741824" returned: 0 in 1.301s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:06 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 Apr 29 09:06:06 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:06 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-55030873-59d4-4eb0-9452-5646b185ec88" returned: 0 in 1.515s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-55030873-59d4-4eb0-9452-5646b185ec88" released by "delete_volume" :: held 2.778s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Created reservations ['b88260bf-100a-459b-81f7-7652cb9c4313'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:07 devstack cinder-volume[84004]: WARNING cinder.quota [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1097246926 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1097246926, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:06:07 devstack cinder-volume[84004]: WARNING cinder.quota [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1097246926 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1097246926, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Created reservations ['7e5071d6-d899-49dd-bcdc-b2425a922776', '506da2f5-0448-440d-a859-bf154b5a5473', 'ff725de2-6707-4b28-9abb-408e65c3b512', 'cf7259ba-579a-4b25-a306-51e681a40cd5'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:07 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:06:07 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:08 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023" returned: 0 in 1.375s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] <== create_volume: return (2820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.833s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde9d7f7-4788-48d6-b47d-2e8d3a3dd4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c2ad9b-0399-49bf-b52a-0996b95df023', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aeaa989-1ee0-4843-828f-2f7d77567d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:08 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Volume volume-14c2ad9b-0399-49bf-b52a-0996b95df023 (14c2ad9b-0399-49bf-b52a-0996b95df023): created successfully Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aeaa989-1ee0-4843-828f-2f7d77567d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Flow 'volume_create_manager' (44be311b-43af-4e49-846f-39b482fe30b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-2dc31979-002c-4fb7-a168-889c29bc684e req-a35bc9e7-71e3-4d65-970a-310b5ddf008e tempest-VolumesSnapshotsTestJSON-541949225 None] Created volume successfully. Apr 29 09:06:08 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.137s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5dee5e56-3733-40a0-a081-cc373f46d852 tempest-GroupsV314Test-78619260 None] Delete group completed successfully. Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Acquiring lock "cinder-quobyte-64720732-9c30-439f-8235-532a29038fc5" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-64720732-9c30-439f-8235-532a29038fc5" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bcb949-3206-4f84-969b-d88f830d49f0]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:09 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 Apr 29 09:06:09 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Creating offline snapshot 45b1f89b-a253-4f16-bcb0-f52c2894b3ad of volume 14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:06:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[564bd8e9-d2f4-478f-a8d9-4cad4d843a9d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:09 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 Apr 29 09:06:09 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:09 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5" returned: 0 in 0.925s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:09 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5 Apr 29 09:06:09 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:10 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023" returned: 0 in 0.904s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:10 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad 1G Apr 29 09:06:10 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:10 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-64720732-9c30-439f-8235-532a29038fc5" returned: 0 in 0.684s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Lock "cinder-quobyte-64720732-9c30-439f-8235-532a29038fc5" released by "delete_volume" :: held 1.708s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:10 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Created reservations ['6be77f7e-64e3-4e0f-953e-800927ebb28c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:10 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Created reservations ['b5d6c3d3-6156-4436-bc3f-4a1c33640ced', 'cf789a7f-3f8d-4448-b094-ab77420451a4', 'e38bd05c-31fb-4ac7-9bfc-c3a6f5f9facb', 'bf5c5ca8-84cb-4740-aa72-a80a52b41556'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:11 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:06:11 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:11 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.980s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:11 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:12 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4d0366a9-cc4e-4d00-8043-4c3343114f23 tempest-GroupsV314Test-78619260 None] Delete group completed successfully. Apr 29 09:06:12 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad 1G" returned: 0 in 1.657s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c2ad9b-0399-49bf-b52a-0996b95df023 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:12 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c2ad9b-0399-49bf-b52a-0996b95df023 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad Apr 29 09:06:12 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:12 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c2ad9b-0399-49bf-b52a-0996b95df023 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad" returned: 0 in 0.769s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:12 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad is being set with open permissions: ugo+rw Apr 29 09:06:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:12 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad Apr 29 09:06:12 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:13 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad" returned: 0 in 0.961s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:13 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.info Apr 29 09:06:13 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:14 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.info" returned: 0 in 0.856s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:14 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.info is being set with open permissions: ugo+rw Apr 29 09:06:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:14 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.info Apr 29 09:06:14 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:15 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.info" returned: 0 in 1.235s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.512s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:16 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-7d522864-c08c-4ffd-896a-9415ced39b34 req-d853c592-cc62-49ce-969e-f34d924f5c72 tempest-VolumesSnapshotsTestJSON-541949225 None] Create snapshot completed successfully Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "cinder-45b1f89b-a253-4f16-bcb0-f52c2894b3ad-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-45b1f89b-a253-4f16-bcb0-f52c2894b3ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "cinder-quobyte-14c2ad9b-0399-49bf-b52a-0996b95df023" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-quobyte-14c2ad9b-0399-49bf-b52a-0996b95df023" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "cinder-quobyte-45b1f89b-a253-4f16-bcb0-f52c2894b3ad" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-quobyte-45b1f89b-a253-4f16-bcb0-f52c2894b3ad" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Deleting offline snapshot 45b1f89b-a253-4f16-bcb0-f52c2894b3ad of volume 14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] snapshot_file for this snap is: volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dce88f8-2398-454d-b4a9-be61d2dc44aa]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:17 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad Apr 29 09:06:17 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:18 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad" returned: 0 in 1.813s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14c2ad9b-0399-49bf-b52a-0996b95df023(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:18 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ff6126-414f-4618-93d7-51487c213b10]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:19 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 Apr 29 09:06:19 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:20 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023" returned: 0 in 1.182s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:20 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad Apr 29 09:06:20 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7c067679-2dea-4dcf-b1fd-84776c348c1e tempest-GroupsV320Test-265425219 None] Group tempest-GroupsV320Test-Group-1966358683: creating Apr 29 09:06:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7c067679-2dea-4dcf-b1fd-84776c348c1e tempest-GroupsV320Test-265425219 None] Group tempest-GroupsV320Test-Group-1966358683: created successfully Apr 29 09:06:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7c067679-2dea-4dcf-b1fd-84776c348c1e tempest-GroupsV320Test-265425219 None] Create group completed successfully. Apr 29 09:06:21 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad" returned: 0 in 1.000s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:21 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad Apr 29 09:06:21 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:21 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023.45b1f89b-a253-4f16-bcb0-f52c2894b3ad" returned: 0 in 0.902s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-quobyte-45b1f89b-a253-4f16-bcb0-f52c2894b3ad" released by "_delete_snapshot" :: held 5.125s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-quobyte-14c2ad9b-0399-49bf-b52a-0996b95df023" released by "delete_snapshot" :: held 5.209s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:22 devstack cinder-volume[84004]: WARNING cinder.quota [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.quota [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Created reservations ['48046574-7492-405b-9248-ea5563ab4b5b', '16fe1f2b-631a-4561-9e66-f1eb43e4d3b6', 'ca83146a-56d9-4114-963a-f627fdb24b77', 'a1958bc6-fd5a-44e7-9f28-84e942bb9b57'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:22 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Delete snapshot completed successfully. Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-ff1dc0b3-9d6f-4244-9dfb-4175bbcda48e req-6d818502-815a-4cc0-bfa7-23f010685e91 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-45b1f89b-a253-4f16-bcb0-f52c2894b3ad-delete_snapshot" released by "delete_snapshot" :: held 5.406s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Created reservations ['4f59225b-34fc-4e01-9e93-b634a28aa6a1'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:22 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:06:22 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "cinder-14c2ad9b-0399-49bf-b52a-0996b95df023-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-14c2ad9b-0399-49bf-b52a-0996b95df023-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "cinder-quobyte-14c2ad9b-0399-49bf-b52a-0996b95df023" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-quobyte-14c2ad9b-0399-49bf-b52a-0996b95df023" acquired by "delete_volume" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:23 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f916dd0-8c85-4fad-80f8-96512417b810]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:23 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.879s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:23 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:23 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d7401a98-6b6b-4aa6-81aa-3a995d75f6e7 tempest-GroupsV320Test-265425219 None] Delete group completed successfully. Apr 29 09:06:23 devstack sudo[86513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 Apr 29 09:06:23 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:24 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023" returned: 0 in 1.178s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:24 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023 Apr 29 09:06:24 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:25 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-14c2ad9b-0399-49bf-b52a-0996b95df023" returned: 0 in 1.000s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-quobyte-14c2ad9b-0399-49bf-b52a-0996b95df023" released by "delete_volume" :: held 2.332s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG cinder.quota [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Created reservations ['01cf17b3-a7cd-454a-8456-4ee470b63c18', '240ad2d9-5b51-4931-b70e-14a34f6c3321', '8476bcab-a6de-48c7-808a-3ba2d591b408', '2cc83351-6810-47a9-badb-de2b83399d61'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:25 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:06:25 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:26 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.902s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:26 devstack cinder-volume[84004]: DEBUG cinder.manager [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Deleted volume successfully. Apr 29 09:06:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-4af86ed7-55da-4378-948f-bea55bbe90a8 req-4f4b6883-4749-4d05-a120-8588468a2639 tempest-VolumesSnapshotsTestJSON-541949225 None] Lock "cinder-14c2ad9b-0399-49bf-b52a-0996b95df023-delete_volume" released by "delete_volume" :: held 3.779s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Acquiring lock "cinder-16f759af-7286-4857-9500-61bbf8f97288-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "cinder-16f759af-7286-4857-9500-61bbf8f97288-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Acquiring lock "cinder-quobyte-16f759af-7286-4857-9500-61bbf8f97288" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "cinder-quobyte-16f759af-7286-4857-9500-61bbf8f97288" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:27 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af31cbf-c6cb-47c1-ada4-785280662ace]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:27 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 Apr 29 09:06:27 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:28 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288" returned: 0 in 1.842s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:28 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288 Apr 29 09:06:28 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Flow 'volume_create_manager' (223d35a7-dbd0-40a9-806b-cffcb3112455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5f9e12-8843-44ab-90c2-a0ed07a3e326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5f9e12-8843-44ab-90c2-a0ed07a3e326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:29Z,deleted=False,deleted_at=None,display_description='',display_name='9c5bda84-db87-48ae-8299-577b5fd498ee-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f458f9-dcc1-4391-a572-bafd0a8fbd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e6fc9259a749078a48d2e60ceabaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='269c6757dab549b886a9b7971a6dbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744ab346-decb-4b58-9446-b45f7fba2378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744ab346-decb-4b58-9446-b45f7fba2378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13371a6-7642-416e-8eaa-2c6f7e635a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13371a6-7642-416e-8eaa-2c6f7e635a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f458f9-dcc1-4391-a572-bafd0a8fbd6d', 'volume_name': 'volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83913212-2730-4ffd-9aef-393164e30259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83913212-2730-4ffd-9aef-393164e30259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fe8f68-415e-40c8-b9e0-24a5035e2de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Volume f6f458f9-dcc1-4391-a572-bafd0a8fbd6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d', 'volume_size': 1} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:29Z,deleted=False,deleted_at=None,display_description='',display_name='9c5bda84-db87-48ae-8299-577b5fd498ee-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f458f9-dcc1-4391-a572-bafd0a8fbd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e6fc9259a749078a48d2e60ceabaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:30Z,use_quota=True,user_id='269c6757dab549b886a9b7971a6dbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Creating volume f6f458f9-dcc1-4391-a572-bafd0a8fbd6d {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:29 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:06:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:30 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d 1073741824 Apr 29 09:06:30 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:30 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-16f759af-7286-4857-9500-61bbf8f97288" returned: 0 in 1.949s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "cinder-quobyte-16f759af-7286-4857-9500-61bbf8f97288" released by "delete_volume" :: held 3.893s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:30 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Created reservations ['df818f83-1bf8-4209-9821-3d851333aa88', 'ec02f8c9-012f-48e3-8066-7be7aaad524c', '3e0fdf4a-caa9-4640-9f25-b3977504d4ef', '5a52b05d-2730-49ed-b4e3-0dc5e0629bd8'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:31 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:06:31 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:31 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d 1073741824" returned: 0 in 1.418s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:31 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d Apr 29 09:06:31 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:32 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.311s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Deleted volume successfully. Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0a9788a5-f674-4e8b-97c2-329ba42b630f tempest-ServerRescueNegativeTestJSON-1386955919 None] Lock "cinder-16f759af-7286-4857-9500-61bbf8f97288-delete_volume" released by "delete_volume" :: held 5.644s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:32 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d" returned: 0 in 1.317s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] <== create_volume: return (2811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.815s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fe8f68-415e-40c8-b9e0-24a5035e2de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc1a4c5-8983-4d66-98fb-aeca26131f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:32 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Volume volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d (f6f458f9-dcc1-4391-a572-bafd0a8fbd6d): created successfully Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc1a4c5-8983-4d66-98fb-aeca26131f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Flow 'volume_create_manager' (223d35a7-dbd0-40a9-806b-cffcb3112455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-01411a75-3070-4945-aef6-0ddbaf2bc6d5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Created volume successfully. Apr 29 09:06:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-c82a9bc1-51b3-4c0a-ae1f-78827fddafff tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-c82a9bc1-51b3-4c0a-ae1f-78827fddafff tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[83abd6b1-940d-4493-af49-695b3ad71782]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-c82a9bc1-51b3-4c0a-ae1f-78827fddafff tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:34 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d Apr 29 09:06:34 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:35 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-c82a9bc1-51b3-4c0a-ae1f-78827fddafff tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d" returned: 0 in 1.159s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-c82a9bc1-51b3-4c0a-ae1f-78827fddafff tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.223s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-c82a9bc1-51b3-4c0a-ae1f-78827fddafff tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce', 'name': 'volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c528f44-2a77-4398-a354-e8f2df2f1271', 'enforce_multipath': True} {{(pid=84004) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 09:06:35 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-2cd008e6-bb1a-4363-b73b-d759bf919ae2 req-c82a9bc1-51b3-4c0a-ae1f-78827fddafff tempest-ServerBootFromVolumeStableRescueTest-530427371 None] attachment_update completed successfully. Apr 29 09:06:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-240ac5d7-6c2c-4972-8daf-e90f76dab56b tempest-GroupSnapshotsTest-2087170784 None] Group tempest-GroupSnapshotsTest-Group-1089227930: creating Apr 29 09:06:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-240ac5d7-6c2c-4972-8daf-e90f76dab56b tempest-GroupSnapshotsTest-2087170784 None] Group tempest-GroupSnapshotsTest-Group-1089227930: created successfully Apr 29 09:06:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-240ac5d7-6c2c-4972-8daf-e90f76dab56b tempest-GroupSnapshotsTest-2087170784 None] Create group completed successfully. Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (42d13dca-f63b-4999-925d-1ef566e9cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bc48d1-f61a-4259-a872-9791179df674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bc48d1-f61a-4259-a872-9791179df674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775630628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b59f730-cf4d-404a-9281-e17ff3cc2ff4,host='devstack@QuobyteHD#QuobyteHD',id=1c6d44c2-e49d-439a-adbf-f90b9dba14a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:39Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(906ea92f-59cd-4254-9c8f-36fbd7880531),volume_type_id=906ea92f-59cd-4254-9c8f-36fbd7880531)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f68113-cad3-42bc-b74c-11ab4c93bf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f68113-cad3-42bc-b74c-11ab4c93bf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88de2407-955b-46b7-b538-e12575b43952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88de2407-955b-46b7-b538-e12575b43952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6d44c2-e49d-439a-adbf-f90b9dba14a1', 'volume_name': 'volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c8b2e4-e4d2-4fb9-9aed-0131336f52ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c8b2e4-e4d2-4fb9-9aed-0131336f52ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf5c9e4-b324-488f-b2df-9488d2a57566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:38 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Volume 1c6d44c2-e49d-439a-adbf-f90b9dba14a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1', 'volume_size': 1} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b59f730-cf4d-404a-9281-e17ff3cc2ff4,created_at=2026-04-29T07:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775630628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b59f730-cf4d-404a-9281-e17ff3cc2ff4,host='devstack@QuobyteHD#QuobyteHD',id=1c6d44c2-e49d-439a-adbf-f90b9dba14a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:39Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(906ea92f-59cd-4254-9c8f-36fbd7880531),volume_type_id=906ea92f-59cd-4254-9c8f-36fbd7880531)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Creating volume 1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:38 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:06:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:38 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 1073741824 Apr 29 09:06:38 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:40 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 1073741824" returned: 0 in 1.049s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:40 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 Apr 29 09:06:40 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:40 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" returned: 0 in 0.604s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf5c9e4-b324-488f-b2df-9488d2a57566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61655284-0693-4e87-8b99-b2ca16a87996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:40 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Volume volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 (1c6d44c2-e49d-439a-adbf-f90b9dba14a1): created successfully Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61655284-0693-4e87-8b99-b2ca16a87996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (42d13dca-f63b-4999-925d-1ef566e9cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:40 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-be27078b-43fe-48fe-a860-6c09013eda54 tempest-GroupSnapshotsTest-2087170784 None] Created volume successfully. Apr 29 09:06:41 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] GroupSnapshot dd59ec16-8baf-4121-9a57-b09e86dde184: creating. Apr 29 09:06:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Group snapshot dd59ec16-8baf-4121-9a57-b09e86dde184: creating. {{(pid=84004) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 09:06:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Creating offline snapshot 9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 of volume 1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:06:41 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[964db576-7ddc-44be-beaf-f39b05643f5a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:41 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 Apr 29 09:06:41 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:42 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" returned: 0 in 1.156s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:42 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 1G Apr 29 09:06:42 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:44 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 1G" returned: 0 in 1.187s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:44 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 Apr 29 09:06:44 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:44 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" returned: 0 in 0.705s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:44 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:06:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:44 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 Apr 29 09:06:44 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:45 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" returned: 0 in 0.662s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:45 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.info Apr 29 09:06:45 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:46 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.info" returned: 0 in 0.660s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:06:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:46 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.info Apr 29 09:06:46 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:46 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.info" returned: 0 in 0.620s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.111s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:46 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-057f7130-a995-47a4-8eb3-83ba52dbcecf tempest-GroupSnapshotsTest-2087170784 None] group_snapshot dd59ec16-8baf-4121-9a57-b09e86dde184: created successfully Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Flow 'volume_create_manager' (a8a2eab6-e2b5-46fe-a9f5-aa0293848c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1912e48-0109-4310-a421-88281dbfcf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1912e48-0109-4310-a421-88281dbfcf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1960917005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca837c2f-1d93-4d7a-b593-4a7cd6468d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1406bbcad02247879025870df78e6ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:47Z,use_quota=True,user_id='01f88b181ec8474e99464fb56235f88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c645ecc5-27b0-403b-80a4-6d4769a210f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c645ecc5-27b0-403b-80a4-6d4769a210f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20837842-b598-4576-acd5-0d867dd3c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20837842-b598-4576-acd5-0d867dd3c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca837c2f-1d93-4d7a-b593-4a7cd6468d61', 'volume_name': 'volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851fff0-422a-43df-85fd-276e73675dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851fff0-422a-43df-85fd-276e73675dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec71f023-6a34-45bb-98e8-4a4bac5bd791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:47 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Volume ca837c2f-1d93-4d7a-b593-4a7cd6468d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61', 'volume_size': 1} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1960917005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca837c2f-1d93-4d7a-b593-4a7cd6468d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1406bbcad02247879025870df78e6ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:47Z,use_quota=True,user_id='01f88b181ec8474e99464fb56235f88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Creating volume ca837c2f-1d93-4d7a-b593-4a7cd6468d61 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:47 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:06:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:47 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 1073741824 Apr 29 09:06:47 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:48 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 1073741824" returned: 0 in 0.997s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:48 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 Apr 29 09:06:48 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:48 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61" returned: 0 in 0.685s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.632s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-9f7ebbb7-32b3-4193-9f20-b8ae6abc0135-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec71f023-6a34-45bb-98e8-4a4bac5bd791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a965c0d3-ba66-4272-b44b-ba3b91dd425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-9f7ebbb7-32b3-4193-9f20-b8ae6abc0135-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Creating volume 359cf609-dae0-45d4-b8b3-ef57a9e67dd3 from snapshot 9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:49 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Volume volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 (ca837c2f-1d93-4d7a-b593-4a7cd6468d61): created successfully Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a965c0d3-ba66-4272-b44b-ba3b91dd425e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Flow 'volume_create_manager' (a8a2eab6-e2b5-46fe-a9f5-aa0293848c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] snapshot: 9f7ebbb7-32b3-4193-9f20-b8ae6abc0135, volume: 359cf609-dae0-45d4-b8b3-ef57a9e67dd3, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:49 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-97faffc8-4c2d-4e7c-b7f2-86121b029a79 tempest-VolumesServicesTestJSON-1463730445 None] Created volume successfully. Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd80cc8-0914-40e7-a1d0-7c1ba0ec77d3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:49 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 Apr 29 09:06:49 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Acquiring lock "cinder-ca837c2f-1d93-4d7a-b593-4a7cd6468d61-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Lock "cinder-ca837c2f-1d93-4d7a-b593-4a7cd6468d61-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Acquiring lock "cinder-quobyte-ca837c2f-1d93-4d7a-b593-4a7cd6468d61" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Lock "cinder-quobyte-ca837c2f-1d93-4d7a-b593-4a7cd6468d61" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3566a9-694a-44bb-859b-af7b0e366ecc]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:49 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 Apr 29 09:06:49 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:50 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" returned: 0 in 1.024s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a24adf-ecb2-4c25-9ae5-abd57198332d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:50 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 Apr 29 09:06:50 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:50 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61" returned: 0 in 1.103s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:50 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61 Apr 29 09:06:50 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:50 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" returned: 0 in 0.831s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:06:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:50 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 Apr 29 09:06:50 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:51 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ca837c2f-1d93-4d7a-b593-4a7cd6468d61" returned: 0 in 0.758s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Lock "cinder-quobyte-ca837c2f-1d93-4d7a-b593-4a7cd6468d61" released by "delete_volume" :: held 1.948s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Created reservations ['08494fdf-4095-48e0-ae1c-11ab225bb329', '47120dcf-01c3-4f14-b973-e36e39d13837', '71cd128c-1e7a-4bed-910b-5d98fc0bb3c3', '4904fdf6-4e61-49ab-9660-6c004665038a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:51 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:06:51 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:53 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.500s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:53 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:06:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Deleted volume successfully. Apr 29 09:06:53 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=84,cinder:SELECT=75,cinder:INSERT=18,cinder:DELETE=5 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:06:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9e6cc14f-733b-4af0-a52f-284c1f3a7086 tempest-VolumesServicesTestJSON-1463730445 None] Lock "cinder-ca837c2f-1d93-4d7a-b593-4a7cd6468d61-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:57 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" returned: 0 in 6.715s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:57 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c23ba8-5530-41d5-a98c-c401ab983d99]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:06:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:57 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 Apr 29 09:06:57 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=78,cinder:UPDATE=73,cinder:INSERT=16,cinder:DELETE=4 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Flow 'volume_create_manager' (d792ebc2-cfeb-44cf-a2f6-632434bf2017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e29241d-2fda-4b37-ad42-01931f0cafe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e29241d-2fda-4b37-ad42-01931f0cafe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-683107879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0354aaa-c74d-4da6-9f7f-be58a72db8a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f4837ad1746349f644b0bebda428a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:58Z,use_quota=True,user_id='710d66a3ec2c4135898b3de1011a4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a93c0f3-5b95-45b1-a3e2-d5183a3edcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a93c0f3-5b95-45b1-a3e2-d5183a3edcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca9019b-7e82-4d83-9947-2f86db990494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca9019b-7e82-4d83-9947-2f86db990494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0354aaa-c74d-4da6-9f7f-be58a72db8a3', 'volume_name': 'volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b0b118-f27a-4742-bcbd-c34cf63ca20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b0b118-f27a-4742-bcbd-c34cf63ca20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bede9ac7-dec1-4185-88dd-ce5a16ac0280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:06:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Volume f0354aaa-c74d-4da6-9f7f-be58a72db8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3', 'volume_size': 1} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:58 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" returned: 0 in 0.961s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:06:58 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Converted 1024.00 MB image at 152.49 MB/s Apr 29 09:06:58 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:06:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:58 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 Apr 29 09:06:58 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:59 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" returned: 0 in 0.823s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" released by "_copy_volume_from_snapshot" :: held 10.475s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-9f7ebbb7-32b3-4193-9f20-b8ae6abc0135-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" released by "_create_volume_from_snapshot" :: held 10.530s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.569s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-683107879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0354aaa-c74d-4da6-9f7f-be58a72db8a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f4837ad1746349f644b0bebda428a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:58Z,use_quota=True,user_id='710d66a3ec2c4135898b3de1011a4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Creating volume f0354aaa-c74d-4da6-9f7f-be58a72db8a3 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:06:59 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:06:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:06:59 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 1073741824 Apr 29 09:06:59 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:06:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-14d4e720-ae91-42b0-811d-c80372d0a5ad tempest-GroupSnapshotsTest-2087170784 None] Create group from source-snapshot-dd59ec16-8baf-4121-9a57-b09e86dde184 completed successfully. Apr 29 09:07:00 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 1073741824" returned: 0 in 1.010s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:00 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 Apr 29 09:07:00 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" acquired by "delete_volume" :: waited 0.032s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3961f19a-7f46-45d8-93c8-b1dfb1795c34]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:01 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 Apr 29 09:07:01 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:01 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3" returned: 0 in 0.749s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bede9ac7-dec1-4185-88dd-ce5a16ac0280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e4cc8e-fb5a-44db-950b-c85215b7e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:01 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Volume volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 (f0354aaa-c74d-4da6-9f7f-be58a72db8a3): created successfully Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e4cc8e-fb5a-44db-950b-c85215b7e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Flow 'volume_create_manager' (d792ebc2-cfeb-44cf-a2f6-632434bf2017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-004aabd3-83c0-4fef-adeb-d06587cc9e27 tempest-VolumesTestJSON-1828185538 None] Created volume successfully. Apr 29 09:07:02 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" returned: 0 in 1.186s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:02 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3 Apr 29 09:07:02 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:02 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:02 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Flow 'volume_create_manager' (5fb6109a-44f2-4127-b3fe-b2b55fc4e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2fd268-19d4-4023-8322-6f09995429b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2fd268-19d4-4023-8322-6f09995429b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-227919695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd02bcd2-6904-46ec-bcb2-560febd2ec64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f4837ad1746349f644b0bebda428a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:03Z,use_quota=True,user_id='710d66a3ec2c4135898b3de1011a4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a681f-32df-40f6-8347-26b642968b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a681f-32df-40f6-8347-26b642968b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b1cc75-6829-4b03-bc26-a6c3d720eca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b1cc75-6829-4b03-bc26-a6c3d720eca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd02bcd2-6904-46ec-bcb2-560febd2ec64', 'volume_name': 'volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3359f90-441c-4b8d-9dfa-6aa7c1324373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3359f90-441c-4b8d-9dfa-6aa7c1324373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32641212-afba-4b88-9d4b-a515960bc186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:02 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Volume dd02bcd2-6904-46ec-bcb2-560febd2ec64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64', 'volume_size': 1} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-227919695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd02bcd2-6904-46ec-bcb2-560febd2ec64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f4837ad1746349f644b0bebda428a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:03Z,use_quota=True,user_id='710d66a3ec2c4135898b3de1011a4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Creating volume dd02bcd2-6904-46ec-bcb2-560febd2ec64 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:02 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:03 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 1073741824 Apr 29 09:07:03 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:03 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" returned: 0 in 1.296s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-359cf609-dae0-45d4-b8b3-ef57a9e67dd3" released by "delete_volume" :: held 2.590s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:03 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.211s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['ad60b8eb-d28d-40e6-b8b8-37890d082ca2'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:03 devstack cinder-volume[84004]: WARNING cinder.quota [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-696822744 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-696822744, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:03 devstack cinder-volume[84004]: WARNING cinder.quota [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-696822744 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-696822744, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['4eacc51e-e6e2-488a-8310-f95304cfe024', '39b6b36b-c3c0-4789-a965-08d1dc883b7b', 'b1304ae9-f6ef-4e9c-a194-cacc575f465c', 'e686846e-c618-4c1e-a75b-550cf929df63'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:04 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:04 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:04 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 1073741824" returned: 0 in 1.459s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:04 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 Apr 29 09:07:04 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot dd59ec16-8baf-4121-9a57-b09e86dde184: deleting Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot dd59ec16-8baf-4121-9a57-b09e86dde184: deleting {{(pid=84004) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 09:07:05 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.143s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-106fddf2-368b-45a7-b42b-e5e8b1e24f3e tempest-GroupSnapshotsTest-2087170784 None] Delete group completed successfully. Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Deleting offline snapshot 9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 of volume 1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] snapshot_file for this snap is: volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a423dd78-4562-48e7-bec3-0d5ca69e55be]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:05 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 Apr 29 09:07:05 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:05 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64" returned: 0 in 1.120s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] <== create_volume: return (2663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.667s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32641212-afba-4b88-9d4b-a515960bc186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85deb757-661a-4c56-849a-3559c87502bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:05 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Volume volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 (dd02bcd2-6904-46ec-bcb2-560febd2ec64): created successfully Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85deb757-661a-4c56-849a-3559c87502bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Flow 'volume_create_manager' (5fb6109a-44f2-4127-b3fe-b2b55fc4e7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-244d5cea-1444-4b70-a42a-6950c943ecf4 tempest-VolumesTestJSON-1828185538 None] Created volume successfully. Apr 29 09:07:06 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" returned: 0 in 1.212s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:07:06 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[201040f1-b2c5-4edf-b8f9-19de5fcb83ee]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:06 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 Apr 29 09:07:06 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Flow 'volume_create_manager' (396c410a-b0df-404b-9770-6cce52029536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1641d346-2a66-4770-884b-fc43ab190a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1641d346-2a66-4770-884b-fc43ab190a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1832458172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2d6317-9560-4364-9aaa-811d9f436982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f4837ad1746349f644b0bebda428a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:07Z,use_quota=True,user_id='710d66a3ec2c4135898b3de1011a4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1816e2b5-ba3e-40d4-8e8d-5da13d9ac646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1816e2b5-ba3e-40d4-8e8d-5da13d9ac646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d071737-4531-4eb8-86f5-96ff5ed6e6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d071737-4531-4eb8-86f5-96ff5ed6e6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed2d6317-9560-4364-9aaa-811d9f436982', 'volume_name': 'volume-ed2d6317-9560-4364-9aaa-811d9f436982', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e752d7-8597-43a5-a288-ce6a84776b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e752d7-8597-43a5-a288-ce6a84776b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528b9d0f-2006-4796-8c0e-0976492421c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:07 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Volume ed2d6317-9560-4364-9aaa-811d9f436982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed2d6317-9560-4364-9aaa-811d9f436982', 'volume_size': 1} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1832458172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2d6317-9560-4364-9aaa-811d9f436982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f4837ad1746349f644b0bebda428a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:07Z,use_quota=True,user_id='710d66a3ec2c4135898b3de1011a4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Creating volume ed2d6317-9560-4364-9aaa-811d9f436982 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:07 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:07 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 1073741824 Apr 29 09:07:07 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:07 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" returned: 0 in 1.257s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:07 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 Apr 29 09:07:07 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:08 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 1073741824" returned: 0 in 1.215s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:08 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 Apr 29 09:07:08 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:08 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" returned: 0 in 1.052s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:08 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135 Apr 29 09:07:08 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:09 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982" returned: 0 in 0.778s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528b9d0f-2006-4796-8c0e-0976492421c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2d6317-9560-4364-9aaa-811d9f436982', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cff9f60-9ce4-4ebb-af9c-02d4d0a16f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Volume volume-ed2d6317-9560-4364-9aaa-811d9f436982 (ed2d6317-9560-4364-9aaa-811d9f436982): created successfully Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cff9f60-9ce4-4ebb-af9c-02d4d0a16f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Flow 'volume_create_manager' (396c410a-b0df-404b-9770-6cce52029536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:09 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3d66b9d0-8e00-43fe-8d92-8e25e6491af1 tempest-VolumesTestJSON-1828185538 None] Created volume successfully. Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Flow 'volume_create_manager' (c355e755-c3ef-4531-bcab-60cad5fc798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c193284e-0d76-45de-9e0e-9a8bd8a15a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c193284e-0d76-45de-9e0e-9a8bd8a15a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1067309189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6231a7c-dc80-4453-b8c4-bf1b3277b578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc87439793124098acf6109d6176b3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:09Z,use_quota=True,user_id='3dfbef43079348bd944e158d3ab83617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a3869e-c2c0-4e32-a52d-0cd352aba23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a3869e-c2c0-4e32-a52d-0cd352aba23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71da55b-8255-4ab8-9322-fc83ac8e1d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71da55b-8255-4ab8-9322-fc83ac8e1d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6231a7c-dc80-4453-b8c4-bf1b3277b578', 'volume_name': 'volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9c6108-0d16-4175-98e6-6d2512be2eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9c6108-0d16-4175-98e6-6d2512be2eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef36291a-0608-4f42-9c1a-06c59a7a6c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:09 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Volume d6231a7c-dc80-4453-b8c4-bf1b3277b578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578', 'volume_size': 1} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1067309189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6231a7c-dc80-4453-b8c4-bf1b3277b578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc87439793124098acf6109d6176b3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:09Z,use_quota=True,user_id='3dfbef43079348bd944e158d3ab83617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Creating volume d6231a7c-dc80-4453-b8c4-bf1b3277b578 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:09 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:09 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 1073741824 Apr 29 09:07:09 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:09 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1.9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" returned: 0 in 0.758s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-9f7ebbb7-32b3-4193-9f20-b8ae6abc0135" released by "_delete_snapshot" :: held 4.434s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" released by "delete_snapshot" :: held 4.480s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:09 devstack cinder-volume[84004]: WARNING cinder.quota [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-696822744 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-696822744, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:09 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['76a618b8-d96f-4005-a78d-cda1bdb8b28e', 'e7186b19-9e1f-4b02-b267-9619f1957ded', '6ea8fad0-baaf-4f7b-8881-858cebd4388b', 'f319bd29-71da-4f0c-9fd3-72d4a0a6a4f4'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:09 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b47b323c-823f-4837-b541-a6eeb9f30e05 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot dd59ec16-8baf-4121-9a57-b09e86dde184: deleted successfully Apr 29 09:07:10 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 1073741824" returned: 0 in 0.896s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:10 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 Apr 29 09:07:10 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" acquired by "delete_volume" :: waited 0.035s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c37672-fef1-417f-b127-4e7e1a209992]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:11 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578" returned: 0 in 0.672s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef36291a-0608-4f42-9c1a-06c59a7a6c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c462f11f-b758-4bf0-a6cb-92f9f8c14510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:11 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 Apr 29 09:07:11 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:11 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Volume volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 (d6231a7c-dc80-4453-b8c4-bf1b3277b578): created successfully Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c462f11f-b758-4bf0-a6cb-92f9f8c14510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Flow 'volume_create_manager' (c355e755-c3ef-4531-bcab-60cad5fc798c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:11 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-13b47900-cabd-4d2b-a924-b0f816d088b6 tempest-VolumesListAdminTestJSON-517283102 None] Created volume successfully. Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "cinder-ed2d6317-9560-4364-9aaa-811d9f436982-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Lock "cinder-ed2d6317-9560-4364-9aaa-811d9f436982-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "cinder-quobyte-ed2d6317-9560-4364-9aaa-811d9f436982" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Lock "cinder-quobyte-ed2d6317-9560-4364-9aaa-811d9f436982" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e635a3e0-7b3f-4a84-a73f-55ebe2fa8fe4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:11 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 Apr 29 09:07:11 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:11 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" returned: 0 in 0.797s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:11 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1 Apr 29 09:07:11 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Flow 'volume_create_manager' (2c56c68e-923d-4365-9920-0a95415b03b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2107da4f-8fe8-4ecf-bd73-34d706a8ce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:12 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2107da4f-8fe8-4ecf-bd73-34d706a8ce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1801747056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53154cd-98e7-401c-a179-0c9ed8d2fba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc87439793124098acf6109d6176b3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:12Z,use_quota=True,user_id='3dfbef43079348bd944e158d3ab83617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78afbc39-7cec-4353-8547-6c5595d3faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78afbc39-7cec-4353-8547-6c5595d3faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39cf208-5502-4ccd-a289-964ebc2e6ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39cf208-5502-4ccd-a289-964ebc2e6ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53154cd-98e7-401c-a179-0c9ed8d2fba7', 'volume_name': 'volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b4ffc8-39ee-42e5-bbe4-3586f1b18dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b4ffc8-39ee-42e5-bbe4-3586f1b18dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4367e2-e662-4c90-a1fd-74bd518898df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:12 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Volume c53154cd-98e7-401c-a179-0c9ed8d2fba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7', 'volume_size': 1} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1801747056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53154cd-98e7-401c-a179-0c9ed8d2fba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc87439793124098acf6109d6176b3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:12Z,use_quota=True,user_id='3dfbef43079348bd944e158d3ab83617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Creating volume c53154cd-98e7-401c-a179-0c9ed8d2fba7 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:12 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982" returned: 0 in 0.890s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:12 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 1073741824 Apr 29 09:07:12 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:12 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982 Apr 29 09:07:12 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:12 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" returned: 0 in 0.714s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-1c6d44c2-e49d-439a-adbf-f90b9dba14a1" released by "delete_volume" :: held 1.598s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['86abdc53-9db2-448c-aa63-64f4800477b8'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:12 devstack cinder-volume[84004]: WARNING cinder.db.sqlalchemy.api [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-696822744'] Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['59f0fc3a-d364-4875-87c3-154c19dbb0cf', 'abd92e99-80a3-4ed0-8b67-32f9e6ba6e00', '89448bf1-1f78-4e0a-9558-9258129aaa18', '805c7d71-d6e6-4d8d-a319-e88ae59cb6e7'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:12 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:12 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:12 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ed2d6317-9560-4364-9aaa-811d9f436982" returned: 0 in 0.673s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Lock "cinder-quobyte-ed2d6317-9560-4364-9aaa-811d9f436982" released by "delete_volume" :: held 1.611s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Created reservations ['04b38200-d525-4827-80c3-b457a9e46951', '3e5f6ff2-8d01-4d09-8ac1-67d001aba770', 'f965ffc1-4550-4551-a202-36df364916b5', 'c4c9dbaa-b626-40ab-94a8-9c11f035450e'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:13 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:13 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:13 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 1073741824" returned: 0 in 0.919s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:13 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 Apr 29 09:07:13 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Acquiring lock "cinder-dd02bcd2-6904-46ec-bcb2-560febd2ec64-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Lock "cinder-dd02bcd2-6904-46ec-bcb2-560febd2ec64-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Acquiring lock "cinder-quobyte-dd02bcd2-6904-46ec-bcb2-560febd2ec64" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Lock "cinder-quobyte-dd02bcd2-6904-46ec-bcb2-560febd2ec64" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e746e-7be4-43bf-bed0-1694d2814fbe]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:13 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.942s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:13 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-712e99ed-1d20-4be2-b35f-4aaf8106b457 tempest-GroupSnapshotsTest-2087170784 None] Delete group completed successfully. Apr 29 09:07:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3b05c750-e1a0-4025-b6f0-81cc8d89d8dc tempest-GroupSnapshotsTest-2087170784 None] Group tempest-GroupSnapshotsTest-Group-1533830426: creating Apr 29 09:07:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3b05c750-e1a0-4025-b6f0-81cc8d89d8dc tempest-GroupSnapshotsTest-2087170784 None] Group tempest-GroupSnapshotsTest-Group-1533830426: created successfully Apr 29 09:07:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3b05c750-e1a0-4025-b6f0-81cc8d89d8dc tempest-GroupSnapshotsTest-2087170784 None] Create group completed successfully. Apr 29 09:07:13 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 Apr 29 09:07:13 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:14 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.944s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:14 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Deleted volume successfully. Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e108b460-3339-4fc6-a64c-f7c9b86e8673 tempest-VolumesTestJSON-1828185538 None] Lock "cinder-ed2d6317-9560-4364-9aaa-811d9f436982-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:14 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7" returned: 0 in 0.858s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4367e2-e662-4c90-a1fd-74bd518898df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c83ea5e-05cd-441e-808e-878b7e8d76e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:14 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Volume volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 (c53154cd-98e7-401c-a179-0c9ed8d2fba7): created successfully Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c83ea5e-05cd-441e-808e-878b7e8d76e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Flow 'volume_create_manager' (2c56c68e-923d-4365-9920-0a95415b03b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:14 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-68136ba1-de1f-4a5f-aed2-47b9933eafeb tempest-VolumesListAdminTestJSON-517283102 None] Created volume successfully. Apr 29 09:07:14 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64" returned: 0 in 0.842s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:14 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64 Apr 29 09:07:14 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Flow 'volume_create_manager' (9c841e2e-8ea3-481d-b5cc-d2a740abb326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1f9038-561d-421f-98d9-adebeb52958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1f9038-561d-421f-98d9-adebeb52958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1767993677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf81f9d-22df-4b00-b694-fb813c8d1fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc87439793124098acf6109d6176b3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:15Z,use_quota=True,user_id='3dfbef43079348bd944e158d3ab83617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb6c6d-5173-4924-a0e8-af8e64b30e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb6c6d-5173-4924-a0e8-af8e64b30e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f4d904-1896-4c54-a20f-da1e44380fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f4d904-1896-4c54-a20f-da1e44380fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf81f9d-22df-4b00-b694-fb813c8d1fa0', 'volume_name': 'volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd055533-2c9a-46c3-a77d-8d08fd0345fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd055533-2c9a-46c3-a77d-8d08fd0345fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2009226-d38c-4b1d-bae2-e0f5fa5cbc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:14 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Volume faf81f9d-22df-4b00-b694-fb813c8d1fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0', 'volume_size': 1} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1767993677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf81f9d-22df-4b00-b694-fb813c8d1fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc87439793124098acf6109d6176b3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:15Z,use_quota=True,user_id='3dfbef43079348bd944e158d3ab83617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Creating volume faf81f9d-22df-4b00-b694-fb813c8d1fa0 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:14 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:14 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 1073741824 Apr 29 09:07:14 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:15 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dd02bcd2-6904-46ec-bcb2-560febd2ec64" returned: 0 in 0.845s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Lock "cinder-quobyte-dd02bcd2-6904-46ec-bcb2-560febd2ec64" released by "delete_volume" :: held 1.792s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Created reservations ['a7e65c17-b433-4c19-a1cd-90ec28dda58a', '30a41e6a-8f6a-4f57-bd34-fcaf09534963', '1801cfbd-7dee-4c89-a1ae-f8f48ac82f5f', 'edfe53ec-7457-4a75-90fd-614226349409'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (e31709ee-e845-4cc1-8562-51f781b82b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b98fa7e-63c9-470b-aac1-962276161154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b98fa7e-63c9-470b-aac1-962276161154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-923632167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352d46af-8bc3-4ccc-95e8-3e5a529e0782,host='devstack@QuobyteHD#QuobyteHD',id=5cefa855-773c-466a-a508-ff898d15a584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:16Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7704705-0477-47de-a5d5-5c87bbdb146f),volume_type_id=a7704705-0477-47de-a5d5-5c87bbdb146f)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7172c2df-8787-4e1b-87d5-a6dfe4651519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7172c2df-8787-4e1b-87d5-a6dfe4651519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972470fb-3039-4529-b1bf-ac7e640bda9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972470fb-3039-4529-b1bf-ac7e640bda9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cefa855-773c-466a-a508-ff898d15a584', 'volume_name': 'volume-5cefa855-773c-466a-a508-ff898d15a584', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06f738d-aa1a-41d1-804b-a381fdae64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:15 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:15 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06f738d-aa1a-41d1-804b-a381fdae64d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9648bd-5ed7-4e74-bb45-f33001fa7746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:15 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Volume 5cefa855-773c-466a-a508-ff898d15a584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cefa855-773c-466a-a508-ff898d15a584', 'volume_size': 1} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Acquiring lock "cinder-f0354aaa-c74d-4da6-9f7f-be58a72db8a3-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Lock "cinder-f0354aaa-c74d-4da6-9f7f-be58a72db8a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Acquiring lock "cinder-quobyte-f0354aaa-c74d-4da6-9f7f-be58a72db8a3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Lock "cinder-quobyte-f0354aaa-c74d-4da6-9f7f-be58a72db8a3" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc18a32-a091-49db-83f7-ad7d4d07ea40]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:16 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 Apr 29 09:07:16 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:16 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 1073741824" returned: 0 in 1.354s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:16 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 Apr 29 09:07:16 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:16 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.161s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:16 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:16 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Deleted volume successfully. Apr 29 09:07:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6bd1b6f4-41ed-4cac-9986-05edc6ef95aa tempest-VolumesTestJSON-1828185538 None] Lock "cinder-dd02bcd2-6904-46ec-bcb2-560febd2ec64-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:16 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3" returned: 0 in 1.025s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:17 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3 Apr 29 09:07:17 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:17 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0" returned: 0 in 0.924s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=352d46af-8bc3-4ccc-95e8-3e5a529e0782,created_at=2026-04-29T07:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-923632167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352d46af-8bc3-4ccc-95e8-3e5a529e0782,host='devstack@QuobyteHD#QuobyteHD',id=5cefa855-773c-466a-a508-ff898d15a584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:16Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7704705-0477-47de-a5d5-5c87bbdb146f),volume_type_id=a7704705-0477-47de-a5d5-5c87bbdb146f)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Creating volume 5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:17 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:17 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 1073741824 Apr 29 09:07:17 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2009226-d38c-4b1d-bae2-e0f5fa5cbc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ed4c1e-5c9e-4717-9a9f-2af47aefc796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:17 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Volume volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 (faf81f9d-22df-4b00-b694-fb813c8d1fa0): created successfully Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ed4c1e-5c9e-4717-9a9f-2af47aefc796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Flow 'volume_create_manager' (9c841e2e-8ea3-481d-b5cc-d2a740abb326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f30152b2-7d5b-44df-94b6-43e216d2d988 tempest-VolumesListAdminTestJSON-517283102 None] Created volume successfully. Apr 29 09:07:17 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f0354aaa-c74d-4da6-9f7f-be58a72db8a3" returned: 0 in 0.675s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Lock "cinder-quobyte-f0354aaa-c74d-4da6-9f7f-be58a72db8a3" released by "delete_volume" :: held 1.762s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Created reservations ['35180b18-f9a8-483c-a4f4-825f2738e0fd', 'f806913f-7fc1-42a2-a102-c56850620740', '08d0bd46-079d-4724-b10d-c0a4cca545a3', '78bb6b2d-ff6b-4c06-a120-90655ecf6461'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:17 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:17 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:18 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 1073741824" returned: 0 in 1.205s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:18 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 Apr 29 09:07:18 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:18 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.898s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Deleted volume successfully. Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Flow 'volume_create_manager' (686fc30e-c36c-43d6-a530-4e1b094bac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a6fae5-916b-4cfd-a526-bbccefdf64c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a6fae5-916b-4cfd-a526-bbccefdf64c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a23e0-2d5e-46f4-8bd0-d7445c23bef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ca7823593743d6967428652fba9782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:19Z,use_quota=True,user_id='7c2f6690f04544d88c2c766aee153018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b931dce-30fa-4262-a3ab-f82382aae610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b931dce-30fa-4262-a3ab-f82382aae610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce4e56c-b49d-49cd-a3a2-8fedb11cd9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce4e56c-b49d-49cd-a3a2-8fedb11cd9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14a23e0-2d5e-46f4-8bd0-d7445c23bef4', 'volume_name': 'volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe18362e-7015-44c8-bfd0-3d3fbceac8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe18362e-7015-44c8-bfd0-3d3fbceac8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b95b92-8b8c-45ee-b065-03307afb6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:18 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Volume f14a23e0-2d5e-46f4-8bd0-d7445c23bef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4', 'volume_size': 1} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-37fedcdf-e356-49b1-b673-99bdb66c04db tempest-VolumesTestJSON-1828185538 None] Lock "cinder-f0354aaa-c74d-4da6-9f7f-be58a72db8a3-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:19 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584" returned: 0 in 0.814s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a23e0-2d5e-46f4-8bd0-d7445c23bef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ca7823593743d6967428652fba9782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:19Z,use_quota=True,user_id='7c2f6690f04544d88c2c766aee153018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Creating volume f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:19 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9648bd-5ed7-4e74-bb45-f33001fa7746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cefa855-773c-466a-a508-ff898d15a584', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:19 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 1073741824 Apr 29 09:07:19 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a75415b-5372-4789-a4a6-16cfa90fe0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:19 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Volume volume-5cefa855-773c-466a-a508-ff898d15a584 (5cefa855-773c-466a-a508-ff898d15a584): created successfully Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a75415b-5372-4789-a4a6-16cfa90fe0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (e31709ee-e845-4cc1-8562-51f781b82b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:19 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-eb165ef4-a5df-4c03-8d02-04b6385a44ad tempest-GroupSnapshotsTest-2087170784 None] Created volume successfully. Apr 29 09:07:20 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 1073741824" returned: 0 in 0.944s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:20 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 Apr 29 09:07:20 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (8f669fa5-ce3e-4295-9187-132c2fc53a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df051044-f800-4bc1-9269-a1aa269e766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df051044-f800-4bc1-9269-a1aa269e766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1485538778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352d46af-8bc3-4ccc-95e8-3e5a529e0782,host='devstack@QuobyteHD#QuobyteHD',id=3aa16c32-962f-47b1-bd29-ff670af93f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:21Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7704705-0477-47de-a5d5-5c87bbdb146f),volume_type_id=a7704705-0477-47de-a5d5-5c87bbdb146f)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb2251a-befc-45f1-8b55-9f85ead480e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb2251a-befc-45f1-8b55-9f85ead480e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b3a2fb-8ed1-4bc3-8337-5f5fce8c2cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b3a2fb-8ed1-4bc3-8337-5f5fce8c2cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa16c32-962f-47b1-bd29-ff670af93f84', 'volume_name': 'volume-3aa16c32-962f-47b1-bd29-ff670af93f84', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3ece18-90dd-4049-a112-03311509f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3ece18-90dd-4049-a112-03311509f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79cf0fd-45fe-4e3c-802d-b245618314e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:20 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Volume 3aa16c32-962f-47b1-bd29-ff670af93f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa16c32-962f-47b1-bd29-ff670af93f84', 'volume_size': 1} Apr 29 09:07:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:21 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4" returned: 0 in 0.738s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=352d46af-8bc3-4ccc-95e8-3e5a529e0782,created_at=2026-04-29T07:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1485538778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=352d46af-8bc3-4ccc-95e8-3e5a529e0782,host='devstack@QuobyteHD#QuobyteHD',id=3aa16c32-962f-47b1-bd29-ff670af93f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:21Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7704705-0477-47de-a5d5-5c87bbdb146f),volume_type_id=a7704705-0477-47de-a5d5-5c87bbdb146f)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Creating volume 3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:21 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:21 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 1073741824 Apr 29 09:07:21 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b95b92-8b8c-45ee-b065-03307afb6128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a56aca5-2fff-4cfa-b87a-1b3e97463940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:21 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Volume volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 (f14a23e0-2d5e-46f4-8bd0-d7445c23bef4): created successfully Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a56aca5-2fff-4cfa-b87a-1b3e97463940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Flow 'volume_create_manager' (686fc30e-c36c-43d6-a530-4e1b094bac78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:21 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-bc1ff231-5e75-46e1-8c9d-cc3d0d0e34ce tempest-VolumesListAdminTestJSON-239394528 None] Created volume successfully. Apr 29 09:07:21 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 1073741824" returned: 0 in 0.848s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:22 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 Apr 29 09:07:22 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Acquiring lock "cinder-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Lock "cinder-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Acquiring lock "cinder-quobyte-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Lock "cinder-quobyte-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d545b460-a52f-4cdb-9237-2ca13f11a9ac]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "cinder-faf81f9d-22df-4b00-b694-fb813c8d1fa0-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-faf81f9d-22df-4b00-b694-fb813c8d1fa0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "cinder-quobyte-faf81f9d-22df-4b00-b694-fb813c8d1fa0" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:22 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 Apr 29 09:07:22 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-quobyte-faf81f9d-22df-4b00-b694-fb813c8d1fa0" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915f714-1962-454d-9444-bdc321bea866]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:22 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 Apr 29 09:07:22 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:22 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84" returned: 0 in 0.649s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79cf0fd-45fe-4e3c-802d-b245618314e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa16c32-962f-47b1-bd29-ff670af93f84', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d0ef2a-bd9d-4c1a-ba75-d52ae3b73105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:22 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Volume volume-3aa16c32-962f-47b1-bd29-ff670af93f84 (3aa16c32-962f-47b1-bd29-ff670af93f84): created successfully Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d0ef2a-bd9d-4c1a-ba75-d52ae3b73105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (8f669fa5-ce3e-4295-9187-132c2fc53a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:22 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-284554cf-69c2-4df9-b078-bee9417972df tempest-GroupSnapshotsTest-2087170784 None] Created volume successfully. Apr 29 09:07:23 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a1edbef9-7d63-4653-85bc-d72056b4623b tempest-GroupSnapshotsTest-2087170784 None] Update group completed successfully. Apr 29 09:07:23 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4" returned: 0 in 0.923s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:23 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4 Apr 29 09:07:23 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4be36119-ce4d-4f5b-a217-e6cbb3ac91ae tempest-BackendsCapabilitiesAdminTestsJSON-435193638 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6153602600098, 'free_capacity_gb': 1775.6153602600098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84004) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 09:07:23 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0" returned: 0 in 1.070s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:23 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0 Apr 29 09:07:23 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eeb46bc3-8447-40d5-b740-de8a7a12b06c tempest-BackendsCapabilitiesAdminTestsJSON-435193638 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6153602600098, 'free_capacity_gb': 1775.6153602600098, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84004) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 09:07:24 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4" returned: 0 in 1.154s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Lock "cinder-quobyte-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4" released by "delete_volume" :: held 2.150s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:24 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-faf81f9d-22df-4b00-b694-fb813c8d1fa0" returned: 0 in 0.941s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:24 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-498ae9e7-ef85-4c70-961c-8724ba744850 tempest-GroupSnapshotsTest-2087170784 None] Update group completed successfully. Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-quobyte-faf81f9d-22df-4b00-b694-fb813c8d1fa0" released by "delete_volume" :: held 2.059s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Created reservations ['c08cd752-5e56-40c2-b675-eeec1ca77fbb', 'af009262-b9c4-404e-acb5-64023526f4d6', '89ed258f-887e-40fb-b169-24e0bb348276', '4911af86-98a9-48bc-86a7-a1ea156f2781'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Created reservations ['e0a4c6f9-4954-4322-8259-bd446f7c1414', 'bc7f191a-5906-4366-b62d-10b81e16a5eb', '1dbb9ca0-4e74-40c9-b4db-5c0890ea8adf', 'fb96fd94-866e-4ded-b36a-9310468b46a4'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:24 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:24 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:24 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:24 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:25 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.720s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:25 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:25 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Deleted volume successfully. Apr 29 09:07:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-13375a40-30a2-47f3-a0dd-786b491f1fac tempest-VolumesListAdminTestJSON-239394528 None] Lock "cinder-f14a23e0-2d5e-46f4-8bd0-d7445c23bef4-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:25 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-96e05dad-cdd9-4185-8041-874d355e5097 tempest-GroupSnapshotsTest-2087170784 None] Update group completed successfully. Apr 29 09:07:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "cinder-c53154cd-98e7-401c-a179-0c9ed8d2fba7-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:26 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.228s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-c53154cd-98e7-401c-a179-0c9ed8d2fba7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Deleted volume successfully. Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4b749fcf-89ad-42bb-bd7d-8bb944a7171b tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-faf81f9d-22df-4b00-b694-fb813c8d1fa0-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "cinder-quobyte-c53154cd-98e7-401c-a179-0c9ed8d2fba7" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-quobyte-c53154cd-98e7-401c-a179-0c9ed8d2fba7" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37e19e0-2cf8-4f9d-ad5a-5d06003ddc80]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:26 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 Apr 29 09:07:26 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:27 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d29f86e9-6ec3-45b1-ad6a-5c369621e784 tempest-GroupSnapshotsTest-2087170784 None] Update group completed successfully. Apr 29 09:07:27 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7" returned: 0 in 1.302s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:27 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7 Apr 29 09:07:27 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:28 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c53154cd-98e7-401c-a179-0c9ed8d2fba7" returned: 0 in 0.913s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-quobyte-c53154cd-98e7-401c-a179-0c9ed8d2fba7" released by "delete_volume" :: held 2.289s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Created reservations ['4529f4cd-1827-45fd-ab56-03eae90ba77a', '4cda6af8-3591-445e-a840-33695154ec66', '35fb3646-0cc9-4d7a-acb9-aa386372d393', '68da17c5-baa7-44dc-838d-af61b87b0097'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:28 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:28 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:28 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] GroupSnapshot c467cde0-5974-438a-b42e-9375330a3906: creating. Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Group snapshot c467cde0-5974-438a-b42e-9375330a3906: creating. {{(pid=84004) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Creating offline snapshot 24b0e612-3929-4059-a11e-7f3a0c2d34e7 of volume 3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc20824-5073-4993-9b24-a97d1bd6e5d1]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:29 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 Apr 29 09:07:29 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:29 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.763s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Deleted volume successfully. Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9cca5e94-d65f-4a2e-acef-8bcb3866582e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-c53154cd-98e7-401c-a179-0c9ed8d2fba7-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "cinder-d6231a7c-dc80-4453-b8c4-bf1b3277b578-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-d6231a7c-dc80-4453-b8c4-bf1b3277b578-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "cinder-quobyte-d6231a7c-dc80-4453-b8c4-bf1b3277b578" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-quobyte-d6231a7c-dc80-4453-b8c4-bf1b3277b578" acquired by "delete_volume" :: waited 0.044s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b8b773-bfd5-45fb-9da9-01cd8d0c1819]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:29 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 Apr 29 09:07:29 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:30 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84" returned: 0 in 1.099s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:30 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 1G Apr 29 09:07:30 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:30 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578" returned: 0 in 0.945s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:30 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578 Apr 29 09:07:30 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:31 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 1G" returned: 0 in 1.353s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa16c32-962f-47b1-bd29-ff670af93f84 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:31 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d6231a7c-dc80-4453-b8c4-bf1b3277b578" returned: 0 in 0.752s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:31 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa16c32-962f-47b1-bd29-ff670af93f84 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 Apr 29 09:07:31 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-quobyte-d6231a7c-dc80-4453-b8c4-bf1b3277b578" released by "delete_volume" :: held 1.794s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Created reservations ['5a37d6be-3ea0-4418-9763-de4f671421a1', '329a840b-4fb7-4ac7-813c-546639cbd7bc', 'c645cd7d-0500-4327-98e7-bc4785012fb5', '5c007bfb-f363-462c-941c-7b9aa7713081'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:31 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:31 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3774a4b4-f543-49a1-af00-e7bf9f2675d5 tempest-GroupSnapshotsV319Test-1771517915 None] Group tempest-GroupSnapshotsV319Test-Group-1290849817: creating Apr 29 09:07:32 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa16c32-962f-47b1-bd29-ff670af93f84 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7" returned: 0 in 1.065s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:32 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:07:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3774a4b4-f543-49a1-af00-e7bf9f2675d5 tempest-GroupSnapshotsV319Test-1771517915 None] Group tempest-GroupSnapshotsV319Test-Group-1290849817: created successfully Apr 29 09:07:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3774a4b4-f543-49a1-af00-e7bf9f2675d5 tempest-GroupSnapshotsV319Test-1771517915 None] Create group completed successfully. Apr 29 09:07:32 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 Apr 29 09:07:32 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:32 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.287s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:32 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Deleted volume successfully. Apr 29 09:07:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9dd535dd-d12a-47c3-a699-7bd4fdddee8e tempest-VolumesListAdminTestJSON-517283102 None] Lock "cinder-d6231a7c-dc80-4453-b8c4-bf1b3277b578-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:33 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7" returned: 0 in 0.938s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:33 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.info Apr 29 09:07:33 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Flow 'volume_create_manager' (3f7e4e52-145a-42b1-9f2f-1cadeae5fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468323b4-733a-4215-86fc-50fa3ebe2a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468323b4-733a-4215-86fc-50fa3ebe2a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071688142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29b4a914-adbb-4428-bdf3-9b133754ed20,host='devstack@QuobyteHD#QuobyteHD',id=f278a857-6b45-422c-a54f-e6d53042d9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef0ada38664d0a8399c5c52bf22b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:35Z,use_quota=True,user_id='30bb4d6d696047c0abc54f9b973dff63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4a9f79b-7a0c-4cc5-bb5d-4765488210ba),volume_type_id=a4a9f79b-7a0c-4cc5-bb5d-4765488210ba)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c2c9ad-90be-468b-ad4e-13f6942a9142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c2c9ad-90be-468b-ad4e-13f6942a9142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a84ea2-4403-40df-9710-8d5dc0725bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a84ea2-4403-40df-9710-8d5dc0725bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f278a857-6b45-422c-a54f-e6d53042d9d3', 'volume_name': 'volume-f278a857-6b45-422c-a54f-e6d53042d9d3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d2d1d7-8840-43b2-9c88-02f10874dcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d2d1d7-8840-43b2-9c88-02f10874dcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da252998-b0a8-466c-bd7a-255df10183cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:34 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Volume f278a857-6b45-422c-a54f-e6d53042d9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f278a857-6b45-422c-a54f-e6d53042d9d3', 'volume_size': 1} Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:34 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.info" returned: 0 in 1.512s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:34 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:07:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:35 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.info Apr 29 09:07:35 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:35 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.info" returned: 0 in 0.752s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.872s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Creating offline snapshot f7830ca9-5754-4e67-84a4-d01950d6dfca of volume 5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:07:35 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb711db-21cc-4a66-9cc0-1655669e6b32]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:35 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 Apr 29 09:07:35 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:36 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584" returned: 0 in 1.057s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:36 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca 1G Apr 29 09:07:36 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:37 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca 1G" returned: 0 in 1.080s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cefa855-773c-466a-a508-ff898d15a584 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:38 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cefa855-773c-466a-a508-ff898d15a584 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca Apr 29 09:07:38 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:38 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cefa855-773c-466a-a508-ff898d15a584 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca" returned: 0 in 0.691s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:38 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:07:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:38 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca Apr 29 09:07:38 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Flow 'volume_create_manager' (a11bcb8c-17fb-4fe1-97e9-e2bea19a904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a972ce-7f11-46a0-be0f-4c8ce0890888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a972ce-7f11-46a0-be0f-4c8ce0890888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-131506877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6283dcf0-af51-437f-a7b6-d66792c9b290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358fe646a5a3496094c8f09fe2006416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:39Z,use_quota=True,user_id='fbc399d68a344a218a4a1f99032056ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c23722-d7ae-414b-ab29-0a8802cdd1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c23722-d7ae-414b-ab29-0a8802cdd1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbfedd1-3ca7-475b-a353-82ce70814455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbfedd1-3ca7-475b-a353-82ce70814455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6283dcf0-af51-437f-a7b6-d66792c9b290', 'volume_name': 'volume-6283dcf0-af51-437f-a7b6-d66792c9b290', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61079853-4e2b-41e0-a36d-8cd6b922a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61079853-4e2b-41e0-a36d-8cd6b922a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1fb77a-5e48-4ffb-a77b-44aa1795bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:39 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Volume 6283dcf0-af51-437f-a7b6-d66792c9b290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6283dcf0-af51-437f-a7b6-d66792c9b290', 'volume_size': 1} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:39 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca" returned: 0 in 0.741s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:39 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.info Apr 29 09:07:39 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:40 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.info" returned: 0 in 0.640s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:40 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:40 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.info Apr 29 09:07:40 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:40 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.info" returned: 0 in 0.626s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.959s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.036s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29b4a914-adbb-4428-bdf3-9b133754ed20,created_at=2026-04-29T07:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071688142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29b4a914-adbb-4428-bdf3-9b133754ed20,host='devstack@QuobyteHD#QuobyteHD',id=f278a857-6b45-422c-a54f-e6d53042d9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ef0ada38664d0a8399c5c52bf22b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:35Z,use_quota=True,user_id='30bb4d6d696047c0abc54f9b973dff63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4a9f79b-7a0c-4cc5-bb5d-4765488210ba),volume_type_id=a4a9f79b-7a0c-4cc5-bb5d-4765488210ba)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Creating volume f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:40 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:40 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 1073741824 Apr 29 09:07:40 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:40 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-53aa1ef8-6910-4f6f-8f3f-ea31e6cc9610 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c467cde0-5974-438a-b42e-9375330a3906: created successfully Apr 29 09:07:41 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 1073741824" returned: 0 in 0.795s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:41 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 Apr 29 09:07:41 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:41 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c467cde0-5974-438a-b42e-9375330a3906: deleting Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c467cde0-5974-438a-b42e-9375330a3906: deleting {{(pid=84004) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-3aa16c32-962f-47b1-bd29-ff670af93f84" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-3aa16c32-962f-47b1-bd29-ff670af93f84" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-24b0e612-3929-4059-a11e-7f3a0c2d34e7" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-24b0e612-3929-4059-a11e-7f3a0c2d34e7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Deleting offline snapshot 24b0e612-3929-4059-a11e-7f3a0c2d34e7 of volume 3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:07:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] snapshot_file for this snap is: volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7c4036-3ccd-4a4f-aab8-93c0b44eca72]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:42 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 Apr 29 09:07:42 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:42 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3" returned: 0 in 0.689s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-131506877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6283dcf0-af51-437f-a7b6-d66792c9b290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358fe646a5a3496094c8f09fe2006416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:39Z,use_quota=True,user_id='fbc399d68a344a218a4a1f99032056ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Creating volume 6283dcf0-af51-437f-a7b6-d66792c9b290 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:42 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da252998-b0a8-466c-bd7a-255df10183cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f278a857-6b45-422c-a54f-e6d53042d9d3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:42 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 1073741824 Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9e455e-4540-45a0-a1d7-87d7989a511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:42 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:42 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Volume volume-f278a857-6b45-422c-a54f-e6d53042d9d3 (f278a857-6b45-422c-a54f-e6d53042d9d3): created successfully Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9e455e-4540-45a0-a1d7-87d7989a511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Flow 'volume_create_manager' (3f7e4e52-145a-42b1-9f2f-1cadeae5fd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:42 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b7f018f6-9709-4374-a073-ec3cf7c88d87 tempest-GroupSnapshotsV319Test-1771517915 None] Created volume successfully. Apr 29 09:07:42 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7" returned: 0 in 0.752s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aa16c32-962f-47b1-bd29-ff670af93f84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c765d9-94e1-43cc-a332-6807f6effcda]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:42 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 Apr 29 09:07:42 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:43 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 1073741824" returned: 0 in 0.820s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:43 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 Apr 29 09:07:43 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:43 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84" returned: 0 in 0.759s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:43 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 Apr 29 09:07:43 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:43 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] GroupSnapshot 29b5c293-c76b-4618-afd2-9f5d1b196d65: creating. Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Group snapshot 29b5c293-c76b-4618-afd2-9f5d1b196d65: creating. {{(pid=84004) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:43 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290" returned: 0 in 0.738s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.177s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1fb77a-5e48-4ffb-a77b-44aa1795bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6283dcf0-af51-437f-a7b6-d66792c9b290', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6787b969-c180-4d97-98c7-2150886212f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Creating offline snapshot 8c761d2f-8266-4c54-b1a9-a71df3ee628b of volume f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:07:43 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Volume volume-6283dcf0-af51-437f-a7b6-d66792c9b290 (6283dcf0-af51-437f-a7b6-d66792c9b290): created successfully Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6787b969-c180-4d97-98c7-2150886212f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Flow 'volume_create_manager' (a11bcb8c-17fb-4fe1-97e9-e2bea19a904e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:44 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5a10e-ead1-45e7-b1e3-5c5fbd9ddaa4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:44 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-060b8913-db33-46e1-8f4f-157f85792607 tempest-AbsoluteLimitsTests-927059920 None] Created volume successfully. Apr 29 09:07:44 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 Apr 29 09:07:44 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:44 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7" returned: 0 in 1.037s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:44 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7 Apr 29 09:07:44 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Acquiring lock "cinder-6283dcf0-af51-437f-a7b6-d66792c9b290-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Lock "cinder-6283dcf0-af51-437f-a7b6-d66792c9b290-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Acquiring lock "cinder-quobyte-6283dcf0-af51-437f-a7b6-d66792c9b290" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Lock "cinder-quobyte-6283dcf0-af51-437f-a7b6-d66792c9b290" acquired by "delete_volume" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:45 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c11f3b-7107-49cc-a47b-c983adc37f33]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:45 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 Apr 29 09:07:45 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:45 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3" returned: 0 in 1.361s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:45 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b 1G Apr 29 09:07:45 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:46 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84.24b0e612-3929-4059-a11e-7f3a0c2d34e7" returned: 0 in 1.618s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-24b0e612-3929-4059-a11e-7f3a0c2d34e7" released by "_delete_snapshot" :: held 4.337s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-3aa16c32-962f-47b1-bd29-ff670af93f84" released by "delete_snapshot" :: held 4.360s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-5cefa855-773c-466a-a508-ff898d15a584" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-5cefa855-773c-466a-a508-ff898d15a584" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-f7830ca9-5754-4e67-84a4-d01950d6dfca" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-f7830ca9-5754-4e67-84a4-d01950d6dfca" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Deleting offline snapshot f7830ca9-5754-4e67-84a4-d01950d6dfca of volume 5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] snapshot_file for this snap is: volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a722a13-c4f4-411a-a20a-f380e12821d3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:46 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290" returned: 0 in 1.287s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:46 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290 Apr 29 09:07:46 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:46 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca Apr 29 09:07:46 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:46 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b 1G" returned: 0 in 1.285s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f278a857-6b45-422c-a54f-e6d53042d9d3 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:46 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f278a857-6b45-422c-a54f-e6d53042d9d3 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b Apr 29 09:07:46 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Flow 'volume_create_manager' (39af9f81-4a14-4b4e-b836-df81be06059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4e4900-c94b-4758-9d58-301ac9898780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4e4900-c94b-4758-9d58-301ac9898780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:47Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d832de0-6c98-45ed-8801-005c14f2e4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e6fc9259a749078a48d2e60ceabaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:47Z,use_quota=True,user_id='269c6757dab549b886a9b7971a6dbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66812c9-5395-46d2-9583-48a63c447487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66812c9-5395-46d2-9583-48a63c447487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c842235-bd6d-4c6d-8170-e43e76ee0c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.image.glance [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Creating Keystone auth plugin from conf {{(pid=84004) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 09:07:47 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6283dcf0-af51-437f-a7b6-d66792c9b290" returned: 0 in 0.999s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Lock "cinder-quobyte-6283dcf0-af51-437f-a7b6-d66792c9b290" released by "delete_volume" :: held 2.370s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Created reservations ['7c57c6fe-658d-419b-a520-abd7c0ed009e', '5fbdbeb7-a142-447b-9360-4cc7de1109c2', 'e919e3c6-511d-4591-8fbc-b65271f6e0ad', 'd036a7d0-1dd5-4841-afb2-633f59b2e0aa'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:47 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca" returned: 0 in 1.181s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cefa855-773c-466a-a508-ff898d15a584(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f728310f-ba23-4fd5-b5a5-dc9d37a7e21a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:47 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f278a857-6b45-422c-a54f-e6d53042d9d3 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b" returned: 0 in 1.103s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:47 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:47 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 Apr 29 09:07:47 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:47 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:47 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:47 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b Apr 29 09:07:47 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c842235-bd6d-4c6d-8170-e43e76ee0c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d832de0-6c98-45ed-8801-005c14f2e4c9', 'volume_name': 'volume-7d832de0-6c98-45ed-8801-005c14f2e4c9', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f5c5ce-f6e7-4571-87bf-cc8f146b1ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f5c5ce-f6e7-4571-87bf-cc8f146b1ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f95cbb1-b20a-4b9f-a29b-3e457b3e86aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:47 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Volume 7d832de0-6c98-45ed-8801-005c14f2e4c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d832de0-6c98-45ed-8801-005c14f2e4c9', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Trying to clone 7d832de0-6c98-45ed-8801-005c14f2e4c9 from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a at location (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]). {{(pid=84004) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 09:07:48 devstack cinder-volume[84004]: INFO cinder.image.image_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Image download 20.69 MB at 20.69 MB/s Apr 29 09:07:48 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584" returned: 0 in 0.915s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:48 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.849s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:48 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Deleted volume successfully. Apr 29 09:07:48 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca Apr 29 09:07:48 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60a80b4-a8ca-49fc-a097-3f5adcf831b9]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:48 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b" returned: 0 in 0.905s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-753c5cbe-7b83-4e40-ab86-2f8414ff04e6 tempest-AbsoluteLimitsTests-927059920 None] Lock "cinder-6283dcf0-af51-437f-a7b6-d66792c9b290-delete_volume" released by "delete_volume" :: held 3.678s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:48 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.info Apr 29 09:07:48 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:48 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD Apr 29 09:07:48 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:49 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.info" returned: 0 in 0.810s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:49 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:49 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.info Apr 29 09:07:49 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:49 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:49 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca" returned: 0 in 1.057s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a is fetched for user 269c6757dab549b886a9b7971a6dbf32. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 09:07:49 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca Apr 29 09:07:49 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9528d7b-3af5-4c99-befc-53f8b0af37c4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:49 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD Apr 29 09:07:49 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:50 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.info" returned: 0 in 0.827s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.487s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:50 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-535f9a8d-e7d1-428c-98d0-3faf587a4b8c tempest-GroupSnapshotsV319Test-1771517915 None] group_snapshot 29b5c293-c76b-4618-afd2-9f5d1b196d65: created successfully Apr 29 09:07:50 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584.f7830ca9-5754-4e67-84a4-d01950d6dfca" returned: 0 in 0.997s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-f7830ca9-5754-4e67-84a4-d01950d6dfca" released by "_delete_snapshot" :: held 4.281s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-5cefa855-773c-466a-a508-ff898d15a584" released by "delete_snapshot" :: held 4.314s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:50 devstack cinder-volume[84004]: WARNING cinder.quota [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-315680180 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-315680180, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:50 devstack cinder-volume[84004]: WARNING cinder.quota [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-315680180 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-315680180, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:50 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD" returned: 0 in 0.987s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:47Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d832de0-6c98-45ed-8801-005c14f2e4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e6fc9259a749078a48d2e60ceabaa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:47Z,use_quota=True,user_id='269c6757dab549b886a9b7971a6dbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Creating volume 7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:50 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:50 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 1073741824 Apr 29 09:07:50 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['b7d7d17e-2289-4bc0-93ce-e70f50fa7f35', '8394bf96-f4cd-4770-8bf6-2daa3b411bae', '7840ae4a-8a20-4b1d-a429-ef1989c15108', 'b740aeb3-3ec3-4d51-a4ad-ebc302849d63'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:50 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['8b74566c-f398-4f0b-a818-adfa552e0d52', '036e0876-4ddb-45a2-911c-861d17231398', 'd64a4f4d-eb4a-423d-96de-f3462c213dce', 'ebb6401e-a1b0-4342-88e9-d0c9247a5c91'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:51 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-89ec7556-f92b-4761-acf8-e219d210fafa tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c467cde0-5974-438a-b42e-9375330a3906: deleted successfully Apr 29 09:07:51 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 1073741824" returned: 0 in 0.894s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:51 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] group_snapshot 29b5c293-c76b-4618-afd2-9f5d1b196d65: deleting Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] group_snapshot 29b5c293-c76b-4618-afd2-9f5d1b196d65: deleting {{(pid=84004) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:51 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Acquiring lock "cinder-quobyte-f278a857-6b45-422c-a54f-e6d53042d9d3" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:51 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Lock "cinder-quobyte-f278a857-6b45-422c-a54f-e6d53042d9d3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Acquiring lock "cinder-quobyte-8c761d2f-8266-4c54-b1a9-a71df3ee628b" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Lock "cinder-quobyte-8c761d2f-8266-4c54-b1a9-a71df3ee628b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Deleting offline snapshot 8c761d2f-8266-4c54-b1a9-a71df3ee628b of volume f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] snapshot_file for this snap is: volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b17c976-1c06-4bdf-b127-e1d6362cb169]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-3aa16c32-962f-47b1-bd29-ff670af93f84" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-3aa16c32-962f-47b1-bd29-ff670af93f84" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:52 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b Apr 29 09:07:52 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba1a1d0-35cf-4c09-ad64-a108e7a431aa]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:52 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 Apr 29 09:07:52 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:52 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 0 in 0.795s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Attempting download of 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume 7d832de0-6c98-45ed-8801-005c14f2e4c9. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b269f-9225-436e-a0e3-6d0dfbfc119c]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_e6sdi1_d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:52 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_e6sdi1_d Apr 29 09:07:52 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:52 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b" returned: 0 in 0.898s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f278a857-6b45-422c-a54f-e6d53042d9d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3561c842-e2ac-4232-be05-c2ed213f35cf]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:53 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 Apr 29 09:07:53 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:53 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84" returned: 0 in 0.917s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:53 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84 Apr 29 09:07:53 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:53 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_e6sdi1_d" returned: 0 in 0.878s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_e6sdi1_d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:53 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_e6sdi1_d Apr 29 09:07:53 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:53 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3" returned: 0 in 0.906s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:53 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b Apr 29 09:07:53 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:53 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3aa16c32-962f-47b1-bd29-ff670af93f84" returned: 0 in 0.795s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-3aa16c32-962f-47b1-bd29-ff670af93f84" released by "delete_volume" :: held 1.812s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-5cefa855-773c-466a-a508-ff898d15a584" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-5cefa855-773c-466a-a508-ff898d15a584" acquired by "delete_volume" :: waited 0.034s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[71926ad9-bc04-475a-aa7f-3759d4c6f38d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=166,cinder:SELECT=128,cinder:DELETE=9,cinder:INSERT=38 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Flow 'volume_create_manager' (646bae0e-a200-4d91-97a3-d0475959bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5e3761-8d5c-495d-aaa6-7f25435f3119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5e3761-8d5c-495d-aaa6-7f25435f3119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1784329366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1985aa73-6e13-4d60-80ad-bde7bc09e834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b10478fb5c49b683deb9e2618a7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:54Z,use_quota=True,user_id='41c7ca2aab0d47d79d91e77c9fd47299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20ad11d-8410-4cb5-8aec-12f7e130bceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20ad11d-8410-4cb5-8aec-12f7e130bceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:54 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 Apr 29 09:07:54 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faec65bd-a3ec-4021-a5d2-c59a43d100fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faec65bd-a3ec-4021-a5d2-c59a43d100fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1985aa73-6e13-4d60-80ad-bde7bc09e834', 'volume_name': 'volume-1985aa73-6e13-4d60-80ad-bde7bc09e834', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625216e3-165a-4173-8739-4d48293e87cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625216e3-165a-4173-8739-4d48293e87cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fcfa91-f5bf-48f1-a594-66f4badc75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:54 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Volume 1985aa73-6e13-4d60-80ad-bde7bc09e834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1985aa73-6e13-4d60-80ad-bde7bc09e834', 'volume_size': 1} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1784329366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1985aa73-6e13-4d60-80ad-bde7bc09e834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b10478fb5c49b683deb9e2618a7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:54Z,use_quota=True,user_id='41c7ca2aab0d47d79d91e77c9fd47299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Creating volume 1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:07:54 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:54 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 1073741824 Apr 29 09:07:54 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_e6sdi1_d" returned: 1 in 0.890s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:54 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_e6sdi1_d' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[19240b7a-fca1-4670-b7c5-e356eb7e964d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:54 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD Apr 29 09:07:54 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:54 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b" returned: 0 in 1.000s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:54 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b Apr 29 09:07:54 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:55 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584" returned: 0 in 0.938s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:55 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584 Apr 29 09:07:55 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:55 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 1073741824" returned: 0 in 0.899s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:55 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 Apr 29 09:07:55 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:55 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] 94604fed-be0e-4d2f-b51a-4c6bf32c717a was qcow2, converting to raw {{(pid=84004) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:55 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:07:55 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:55 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3.8c761d2f-8266-4c54-b1a9-a71df3ee628b" returned: 0 in 0.775s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Lock "cinder-quobyte-8c761d2f-8266-4c54-b1a9-a71df3ee628b" released by "_delete_snapshot" :: held 3.777s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Lock "cinder-quobyte-f278a857-6b45-422c-a54f-e6d53042d9d3" released by "delete_snapshot" :: held 3.818s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:55 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5cefa855-773c-466a-a508-ff898d15a584" returned: 0 in 0.685s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-5cefa855-773c-466a-a508-ff898d15a584" released by "delete_volume" :: held 1.710s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:55 devstack cinder-volume[84004]: WARNING cinder.quota [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1351596670 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1351596670, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:55 devstack cinder-volume[84004]: WARNING cinder.quota [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1351596670 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1351596670, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] Created reservations ['9c2f6e30-ed09-474d-babb-05c5a62c7292', 'e20e7a40-8cfd-4fe6-b6ef-a2b311a24ccd', 'f35c5857-0465-48d3-9aa3-ea977022e2c7', 'a84e8b09-20ec-418c-9558-512e3c352ef9'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['12eea0a3-baa7-41ce-bae8-0c5837bf5149'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:55 devstack cinder-volume[84004]: WARNING cinder.quota [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-315680180 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-315680180, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:55 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834" returned: 0 in 0.701s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:55 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-10e5d74c-44ba-478f-9aa6-78122e91c65f tempest-GroupSnapshotsV319Test-1771517915 None] group_snapshot 29b5c293-c76b-4618-afd2-9f5d1b196d65: deleted successfully Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['0a91a4ed-bfe6-401c-a120-79bc997e181b', 'bd19b7d4-b863-4712-818a-a177398e05f4', 'fafffa4a-fae7-44d1-a08e-431922fd0f1b', '29af6e52-2715-4338-bdfc-685f77f19798'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fcfa91-f5bf-48f1-a594-66f4badc75c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1985aa73-6e13-4d60-80ad-bde7bc09e834', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d1ece9-00d8-4513-b551-50df9e75e5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:55 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Volume volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 (1985aa73-6e13-4d60-80ad-bde7bc09e834): created successfully Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d1ece9-00d8-4513-b551-50df9e75e5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Flow 'volume_create_manager' (646bae0e-a200-4d91-97a3-d0475959bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:56 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-13f1d473-0745-415b-8942-394d8d863483 tempest-VolumesDeleteCascade-1670486250 None] Created volume successfully. Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['f4668c46-0f4c-4249-9e8b-c515b17595fc', '8b49f434-01f9-4397-adb5-6930a1136cb6', '0a09e723-02ef-4f7c-9b55-af401ce2c2c6', 'c0e70276-d69c-420f-a4e8-9f7c7ad33a4a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:56 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:56 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Acquiring lock "cinder-quobyte-f278a857-6b45-422c-a54f-e6d53042d9d3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "cinder-quobyte-f278a857-6b45-422c-a54f-e6d53042d9d3" acquired by "delete_volume" :: waited 0.043s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afd628-1ac5-4f43-be86-52f19e1960ad]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Creating offline snapshot 66f4b774-b2e2-410d-bd81-1de8de4053a4 of volume 1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[58448103-1a1a-4fb1-b8de-0ced520e78bc]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:56 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 Apr 29 09:07:56 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:57 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 Apr 29 09:07:57 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:57 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.893s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:57 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b125d901-6670-4939-bde2-a9d4afd60ddd tempest-GroupSnapshotsTest-2087170784 None] Delete group completed successfully. Apr 29 09:07:57 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1e33e297-757b-472c-b604-86eac4f6d08a tempest-GroupSnapshotsTest-2087170784 None] Group tempest-GroupSnapshotsTest-Group-1452229801: creating Apr 29 09:07:57 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1e33e297-757b-472c-b604-86eac4f6d08a tempest-GroupSnapshotsTest-2087170784 None] Group tempest-GroupSnapshotsTest-Group-1452229801: created successfully Apr 29 09:07:57 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1e33e297-757b-472c-b604-86eac4f6d08a tempest-GroupSnapshotsTest-2087170784 None] Create group completed successfully. Apr 29 09:07:57 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3" returned: 0 in 0.966s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:57 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3 Apr 29 09:07:57 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:57 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834" returned: 0 in 0.928s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:57 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 1G Apr 29 09:07:57 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:57 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 0 in 2.619s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_9k8hix7jdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:07:57 devstack cinder-volume[84004]: INFO cinder.image.image_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Converted 112.00 MB image at 42.74 MB/s Apr 29 09:07:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:57 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 1G Apr 29 09:07:57 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:58 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f278a857-6b45-422c-a54f-e6d53042d9d3" returned: 0 in 0.674s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "cinder-quobyte-f278a857-6b45-422c-a54f-e6d53042d9d3" released by "delete_volume" :: held 1.741s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Created reservations ['9ca56f94-3867-45db-8a97-2a4dde26b87a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:58 devstack cinder-volume[84004]: WARNING cinder.quota [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1351596670 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1351596670, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=174,cinder:SELECT=165,cinder:INSERT=40,cinder:DELETE=11 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Created reservations ['52a0cbe8-990f-40d2-a4c1-5a09c9bc4ea1', 'eb58ddcd-9819-4fb7-84cc-746b7ec4f65a', '926753e6-c3f8-4b1f-a92d-ae7d3c91f5bf', '3fd0e523-6b65-4760-aa9e-12249a12fe6e'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:07:58 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 1G" returned: 0 in 0.821s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:58 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 1G" returned: 0 in 0.683s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:58 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 Apr 29 09:07:58 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:58 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:07:58 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cba662e-d7a5-40d8-9b4e-bc183954986e]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:07:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:58 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:07:58 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (060ddc2a-beae-4938-a630-37f197328f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cdec72-1248-4ead-8ad7-6eec4c0a7dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cdec72-1248-4ead-8ad7-6eec4c0a7dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108834159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73b506d6-1aeb-40a9-ae89-9afdbbd6616b,host='devstack@QuobyteHD#QuobyteHD',id=0b8bd693-b85f-4c8b-b523-b907ee0d30ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:59Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2673eb7d-47a0-4a46-902b-306893766193),volume_type_id=2673eb7d-47a0-4a46-902b-306893766193)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0234950-0e49-4c78-9162-3706f9dc87fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0234950-0e49-4c78-9162-3706f9dc87fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fa5155-9089-420e-bd71-2839fdd39154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fa5155-9089-420e-bd71-2839fdd39154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8bd693-b85f-4c8b-b523-b907ee0d30ca', 'volume_name': 'volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884a0154-7139-4fb5-a5b9-1c6d0e887e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884a0154-7139-4fb5-a5b9-1c6d0e887e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0c42fb-385a-4a22-9eef-1280232e4225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:07:59 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Volume 0b8bd693-b85f-4c8b-b523-b907ee0d30ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca', 'volume_size': 1} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.948s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:07:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8d81f01a-ef16-4364-8e92-9d92093ce190 tempest-GroupSnapshotsV319Test-1771517915 None] Delete group completed successfully. Apr 29 09:07:59 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 0 in 0.933s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:59 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4" returned: 0 in 1.075s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:07:59 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 is being set with open permissions: ugo+rw Apr 29 09:07:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:07:59 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 Apr 29 09:07:59 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:07:59 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:07:59 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:00 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4" returned: 0 in 0.689s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:00 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 1 in 0.784s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Downloaded image 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume 7d832de0-6c98-45ed-8801-005c14f2e4c9 successfully. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a for user 269c6757dab549b886a9b7971a6dbf32 is deleted. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Marking volume 7d832de0-6c98-45ed-8801-005c14f2e4c9 as bootable. {{(pid=84004) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Copying metadata from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a to 7d832de0-6c98-45ed-8801-005c14f2e4c9. {{(pid=84004) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Creating volume glance metadata for volume 7d832de0-6c98-45ed-8801-005c14f2e4c9 backed by image 94604fed-be0e-4d2f-b51a-4c6bf32c717a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84004) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 09:08:00 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.info Apr 29 09:08:00 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f95cbb1-b20a-4b9f-a29b-3e457b3e86aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d832de0-6c98-45ed-8801-005c14f2e4c9', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669af71b-46fb-4afa-97c7-68251f428b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:00 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Volume volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 (7d832de0-6c98-45ed-8801-005c14f2e4c9): created successfully Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669af71b-46fb-4afa-97c7-68251f428b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Flow 'volume_create_manager' (39af9f81-4a14-4b4e-b836-df81be06059f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:00 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-50fbf8d0-c02e-4537-b858-0993cfa28bd5 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Created volume successfully. Apr 29 09:08:01 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.info" returned: 0 in 0.639s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:01 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.info is being set with open permissions: ugo+rw Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:01 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.info Apr 29 09:08:01 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:01 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.info" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.948s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73b506d6-1aeb-40a9-ae89-9afdbbd6616b,created_at=2026-04-29T07:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108834159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73b506d6-1aeb-40a9-ae89-9afdbbd6616b,host='devstack@QuobyteHD#QuobyteHD',id=0b8bd693-b85f-4c8b-b523-b907ee0d30ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2642fe8c0045348f0825ed830cbcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:59Z,use_quota=True,user_id='2f5e9d3bb9594898b8947d8b3eb35356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2673eb7d-47a0-4a46-902b-306893766193),volume_type_id=2673eb7d-47a0-4a46-902b-306893766193)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Creating volume 0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:01 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:01 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca 1073741824 Apr 29 09:08:01 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e2027500-f4b3-4c05-b496-832ec630eefa tempest-VolumesDeleteCascade-1670486250 None] Create snapshot completed successfully Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:02 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:02 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:02 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca 1073741824" returned: 0 in 0.900s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:02 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca Apr 29 09:08:02 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:03 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.784s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:03 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" returned: 0 in 0.736s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.239s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Creating offline snapshot fee9e1af-95fe-45a3-b6de-4ef378227ac0 of volume 1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0c42fb-385a-4a22-9eef-1280232e4225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b45ec3-b301-41d1-b117-f4afa1bb2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7ac65a-c790-4a07-8e67-8f83928f338e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:03 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Volume volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca (0b8bd693-b85f-4c8b-b523-b907ee0d30ca): created successfully Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b45ec3-b301-41d1-b117-f4afa1bb2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Flow 'volume_create_manager' (060ddc2a-beae-4938-a630-37f197328f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:03 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c9939413-72f8-42d8-9257-2e2420a51ef5 tempest-GroupSnapshotsTest-2087170784 None] Created volume successfully. Apr 29 09:08:03 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 Apr 29 09:08:03 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] GroupSnapshot c355fac9-4046-4d2e-b39e-f72976b55b7b: creating. Apr 29 09:08:04 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Group snapshot c355fac9-4046-4d2e-b39e-f72976b55b7b: creating. {{(pid=84004) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 09:08:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:04 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4" returned: 0 in 0.858s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1985aa73-6e13-4d60-80ad-bde7bc09e834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:04 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 1G Apr 29 09:08:04 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:05 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 1G" returned: 0 in 0.802s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:05 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 Apr 29 09:08:05 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:05 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0" returned: 0 in 0.724s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:05 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 is being set with open permissions: ugo+rw Apr 29 09:08:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:05 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 Apr 29 09:08:05 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:06 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0" returned: 0 in 0.702s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.422s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0974de24-a035-4d33-8b2a-ae0c611309c0 tempest-VolumesDeleteCascade-1670486250 None] Create snapshot completed successfully Apr 29 09:08:06 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b202967-30d7-48d1-aeed-44e654298581]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:06 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:08:06 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-1985aa73-6e13-4d60-80ad-bde7bc09e834-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-1985aa73-6e13-4d60-80ad-bde7bc09e834-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:07 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 0 in 0.831s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Performing cascade delete. {{(pid=84004) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-66f4b774-b2e2-410d-bd81-1de8de4053a4-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-66f4b774-b2e2-410d-bd81-1de8de4053a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-66f4b774-b2e2-410d-bd81-1de8de4053a4" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-66f4b774-b2e2-410d-bd81-1de8de4053a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Deleting offline snapshot 66f4b774-b2e2-410d-bd81-1de8de4053a4 of volume 1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:08:07 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:08:07 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] snapshot_file for this snap is: volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e6da00-5c6f-4a89-88d8-86ff6478d8e0]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:07 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 Apr 29 09:08:07 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:08 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 1 in 1.023s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.915s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.524s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Creating offline snapshot c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 of volume 0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:08:08 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4" returned: 0 in 0.912s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1985aa73-6e13-4d60-80ad-bde7bc09e834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc1a81c-151f-4c20-bf6f-1b093ca96d6d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce', 'name': 'volume-7d832de0-6c98-45ed-8801-005c14f2e4c9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9bb7583-12e3-4c21-bfd7-b909b30efa53', 'enforce_multipath': True} {{(pid=84004) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26fbaba-5fb4-459b-a013-37b784fe48d8]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-5d88e20f-3a12-4f1c-b696-64f2ebd39d56 req-3b5894b9-c76d-4c73-9cbb-fc8769327c02 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] attachment_update completed successfully. Apr 29 09:08:08 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca Apr 29 09:08:08 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:08 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 Apr 29 09:08:08 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:09 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" returned: 0 in 0.798s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:09 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 1G Apr 29 09:08:09 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:09 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834" returned: 0 in 0.824s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bab0298-07e8-458a-8400-188caf221252]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:09 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 Apr 29 09:08:09 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:10 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 1G" returned: 0 in 0.889s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:10 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 Apr 29 09:08:10 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:10 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0" returned: 0 in 0.983s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1985aa73-6e13-4d60-80ad-bde7bc09e834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:10 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[45284f5b-0eb4-4787-95c7-66fa30d1e023]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:10 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 Apr 29 09:08:10 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:11 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" returned: 0 in 0.807s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:11 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:11 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 Apr 29 09:08:11 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:11 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4" returned: 0 in 0.806s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1985aa73-6e13-4d60-80ad-bde7bc09e834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c480cad-b667-497b-9c63-030876193806]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:11 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 Apr 29 09:08:11 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:11 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" returned: 0 in 0.688s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:11 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.info Apr 29 09:08:11 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:12 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834" returned: 0 in 0.865s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:12 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 Apr 29 09:08:12 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:12 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.info" returned: 0 in 0.710s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:12 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 09:08:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:12 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.info Apr 29 09:08:12 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:13 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4" returned: 0 in 0.816s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:13 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4 Apr 29 09:08:13 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:13 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.info" returned: 0 in 0.631s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.645s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5cad2123-8f22-413e-9cd1-77ed0389b4a9 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c355fac9-4046-4d2e-b39e-f72976b55b7b: created successfully Apr 29 09:08:13 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.66f4b774-b2e2-410d-bd81-1de8de4053a4" returned: 0 in 0.644s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 -F qcow2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:13 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 -F qcow2 Apr 29 09:08:13 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:14 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c355fac9-4046-4d2e-b39e-f72976b55b7b: deleting Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c355fac9-4046-4d2e-b39e-f72976b55b7b: deleting {{(pid=84004) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Deleting offline snapshot c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 of volume 0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] snapshot_file for this snap is: volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e361ea40-9309-49c2-b7b7-011c36e858ba]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:14 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 Apr 29 09:08:14 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:15 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 -F qcow2" returned: 0 in 1.354s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-66f4b774-b2e2-410d-bd81-1de8de4053a4" released by "_delete_snapshot" :: held 7.445s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" released by "delete_snapshot" :: held 7.475s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Created reservations ['735eac99-a3d9-4bb4-a2ba-767822856030', '3f833a41-b7b9-47d7-a508-4412faa42fdb', 'd3ee6d33-b22c-4ee5-9b7a-7936d48c7743', '7923844a-a23c-440c-819d-eb354d6f5694'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:15 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Delete snapshot completed successfully. Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-66f4b774-b2e2-410d-bd81-1de8de4053a4-delete_snapshot" released by "delete_snapshot" :: held 7.694s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-fee9e1af-95fe-45a3-b6de-4ef378227ac0-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-fee9e1af-95fe-45a3-b6de-4ef378227ac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-fee9e1af-95fe-45a3-b6de-4ef378227ac0" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-fee9e1af-95fe-45a3-b6de-4ef378227ac0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Deleting offline snapshot fee9e1af-95fe-45a3-b6de-4ef378227ac0 of volume 1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] snapshot_file for this snap is: volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[979aed40-6484-4c07-8ac2-79ed689f78c9]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:15 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" returned: 0 in 1.182s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d06a79-37d9-4a88-ac30-250f701cff1f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:15 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 Apr 29 09:08:15 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:15 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca Apr 29 09:08:15 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:16 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0" returned: 0 in 1.135s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1985aa73-6e13-4d60-80ad-bde7bc09e834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:16 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" returned: 0 in 1.074s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:16 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24137c7-5dac-4a73-bd68-3669bd0493eb]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:16 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 Apr 29 09:08:16 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:16 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 Apr 29 09:08:16 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:17 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834" returned: 0 in 1.093s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:17 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 Apr 29 09:08:17 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:18 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" returned: 0 in 1.615s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:18 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463 Apr 29 09:08:18 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:19 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0" returned: 0 in 1.427s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:19 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0 Apr 29 09:08:19 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Flow 'volume_create_manager' (462dd35c-df68-48fc-a196-b3ab6382c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:19 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774ad0f2-64c4-4dc5-886f-cad066b45048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca.c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" returned: 0 in 1.560s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774ad0f2-64c4-4dc5-886f-cad066b45048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1609971333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d026d8-792b-42f5-b436-4ac26abf5998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aed40fc540443ebb22a6a4efee05852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:20Z,use_quota=True,user_id='9506a680def340b689d54557ea493237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d7260e-15ae-4069-9455-81bdf1cf7e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d7260e-15ae-4069-9455-81bdf1cf7e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a7ce97-c614-4703-bec5-6deaa22e6d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a7ce97-c614-4703-bec5-6deaa22e6d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d026d8-792b-42f5-b436-4ac26abf5998', 'volume_name': 'volume-95d026d8-792b-42f5-b436-4ac26abf5998', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0659305-6ea1-4f1d-bf40-0c473da0edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0659305-6ea1-4f1d-bf40-0c473da0edec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b2e25-caa2-423e-ba5d-f1ba8f46b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:19 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Volume 95d026d8-792b-42f5-b436-4ac26abf5998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d026d8-792b-42f5-b436-4ac26abf5998', 'volume_size': 1} Apr 29 09:08:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1609971333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d026d8-792b-42f5-b436-4ac26abf5998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aed40fc540443ebb22a6a4efee05852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:20Z,use_quota=True,user_id='9506a680def340b689d54557ea493237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Creating volume 95d026d8-792b-42f5-b436-4ac26abf5998 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:20 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-c065f2c1-0dc6-44f5-a6b8-f4b3b46ac463" released by "_delete_snapshot" :: held 5.728s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" released by "delete_snapshot" :: held 5.807s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:20 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 1073741824 Apr 29 09:08:20 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:20 devstack cinder-volume[84004]: WARNING cinder.quota [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-623823308 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-623823308, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:08:20 devstack cinder-volume[84004]: WARNING cinder.quota [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-623823308 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-623823308, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['2efb90f5-349d-43cc-9883-e3fe0c8e6361', 'ae0385cb-cd07-44de-b98d-4d71e0458942', 'e5ed89cf-1fac-45da-b67f-6126cf0c8e29', 'e4ac6de6-c07a-4524-9a94-d5d401869462'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1454b3e9-5247-4789-9616-055513e9d657 tempest-GroupSnapshotsTest-2087170784 None] group_snapshot c355fac9-4046-4d2e-b39e-f72976b55b7b: deleted successfully Apr 29 09:08:20 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834.fee9e1af-95fe-45a3-b6de-4ef378227ac0" returned: 0 in 1.138s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-fee9e1af-95fe-45a3-b6de-4ef378227ac0" released by "_delete_snapshot" :: held 4.974s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" released by "delete_snapshot" :: held 5.010s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Created reservations ['3545eccf-23bc-4f4a-85f4-b622007d6307', 'f8604901-1473-45c3-a0f4-9ff1f48c7ed9', '12f76a9a-fb14-4fb5-b6c7-910f17b8526a', '0157389a-7e2b-493d-9b3b-e139ad08314f'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Delete snapshot completed successfully. Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-fee9e1af-95fe-45a3-b6de-4ef378227ac0-delete_snapshot" released by "delete_snapshot" :: held 5.233s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Snapshots deleted, issuing volume delete {{(pid=84004) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d922e2-a306-48d0-9178-4f86c070c491]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:20 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 Apr 29 09:08:20 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:21 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 1073741824" returned: 0 in 1.349s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:21 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 Apr 29 09:08:21 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "cinder-quobyte-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" acquired by "delete_volume" :: waited 0.066s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:21 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f59df0-7068-4779-ace7-b78f4c6d2b21]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:22 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca Apr 29 09:08:22 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:22 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834" returned: 0 in 1.805s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:22 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834 Apr 29 09:08:22 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:22 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998" returned: 0 in 1.118s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] <== create_volume: return (2576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.586s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b2e25-caa2-423e-ba5d-f1ba8f46b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d026d8-792b-42f5-b436-4ac26abf5998', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29807a38-6516-4a71-8684-e707509cba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:22 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Volume volume-95d026d8-792b-42f5-b436-4ac26abf5998 (95d026d8-792b-42f5-b436-4ac26abf5998): created successfully Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29807a38-6516-4a71-8684-e707509cba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Flow 'volume_create_manager' (462dd35c-df68-48fc-a196-b3ab6382c7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:22 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-40b29f1a-3f52-44fe-b20c-a67f2788ce50 tempest-VolumeQuotasAdminTestJSON-785284720 None] Created volume successfully. Apr 29 09:08:23 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" returned: 0 in 1.212s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:23 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca Apr 29 09:08:23 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Acquiring lock "cinder-95d026d8-792b-42f5-b436-4ac26abf5998-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "cinder-95d026d8-792b-42f5-b436-4ac26abf5998-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Acquiring lock "cinder-quobyte-95d026d8-792b-42f5-b436-4ac26abf5998" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "cinder-quobyte-95d026d8-792b-42f5-b436-4ac26abf5998" acquired by "delete_volume" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefc8572-4c2e-46fd-937f-7018987315c5]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:23 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 Apr 29 09:08:23 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:23 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1985aa73-6e13-4d60-80ad-bde7bc09e834" returned: 0 in 1.357s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-1985aa73-6e13-4d60-80ad-bde7bc09e834" released by "delete_volume" :: held 3.260s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Created reservations ['1c6a2c9f-9eca-4dd9-a61a-15463eef6cdf', '305ed2e7-e1a5-40da-bdb2-6d1a1f6a4aed', '0b156cde-52b6-448d-bd1b-4975448f546d', '2696c1cc-d2b9-4320-accc-9d43586061d8'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:24 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:24 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:24 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" returned: 0 in 1.150s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Lock "cinder-quobyte-0b8bd693-b85f-4c8b-b523-b907ee0d30ca" released by "delete_volume" :: held 2.561s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['0a8d8349-0cb4-4f1f-b3e7-68e5f279d718'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:24 devstack cinder-volume[84004]: WARNING cinder.quota [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-623823308 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-623823308, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Created reservations ['ad6d186b-2840-4cc7-83f0-b525c47f08e8', '7c246b59-1eaf-4506-9238-c2e4dd21ff99', 'a8538fd7-66ea-4d05-8c7a-2d3a1e45dd00', '8a064ee9-10f5-48d5-ae0d-0caadfa66f79'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:24 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998" returned: 0 in 1.311s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:24 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998 Apr 29 09:08:24 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:24 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:24 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:25 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.949s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:25 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Deleted volume successfully. Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9605c98-d4c0-4863-9bf3-d731b2051208 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-1985aa73-6e13-4d60-80ad-bde7bc09e834-delete_volume" released by "delete_volume" :: held 17.578s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Flow 'volume_create_manager' (f0843ffb-81bb-4665-9b00-7a34ca2e6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4d22ee-373b-4fdc-8a90-4900af6e80c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4d22ee-373b-4fdc-8a90-4900af6e80c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1505473997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f3bc12-0ed4-4668-bcbf-fe52d8195853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b10478fb5c49b683deb9e2618a7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:26Z,use_quota=True,user_id='41c7ca2aab0d47d79d91e77c9fd47299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:25 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ea3ce-45ec-4e4f-81e8-1dcc282dfc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ea3ce-45ec-4e4f-81e8-1dcc282dfc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff04dbf-bf2c-4d05-a753-0c4dbb5dbad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff04dbf-bf2c-4d05-a753-0c4dbb5dbad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f3bc12-0ed4-4668-bcbf-fe52d8195853', 'volume_name': 'volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fb11e8-1cdf-4fdf-b63a-bfd86f44aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fb11e8-1cdf-4fdf-b63a-bfd86f44aa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4a2b5d-36fb-4ec8-b182-8cc0b2135e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:25 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Volume a9f3bc12-0ed4-4668-bcbf-fe52d8195853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853', 'volume_size': 1} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1505473997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f3bc12-0ed4-4668-bcbf-fe52d8195853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b10478fb5c49b683deb9e2618a7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:26Z,use_quota=True,user_id='41c7ca2aab0d47d79d91e77c9fd47299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Creating volume a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:25 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.934s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:25 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:25 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1cbb74e8-0ab1-41ab-b576-6287df895607 tempest-GroupSnapshotsTest-2087170784 None] Delete group completed successfully. Apr 29 09:08:25 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 1073741824 Apr 29 09:08:25 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:26 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-95d026d8-792b-42f5-b436-4ac26abf5998" returned: 0 in 1.286s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "cinder-quobyte-95d026d8-792b-42f5-b436-4ac26abf5998" released by "delete_volume" :: held 2.663s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Created reservations ['caec7631-1f35-459b-8d88-820aa4706267', '45923939-dc32-4462-988a-efa77b4075cf', 'f5010c6c-8474-4a99-898b-83649f5d5821', '85ef351b-5998-480b-ae3f-b344f6c3f253'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:26 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:26 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:27 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.872s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:27 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Deleted volume successfully. Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e3f0effc-251e-40f7-bf90-0fdc661bdef0 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "cinder-95d026d8-792b-42f5-b436-4ac26abf5998-delete_volume" released by "delete_volume" :: held 3.897s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:27 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 1073741824" returned: 0 in 1.520s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:27 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 Apr 29 09:08:27 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Flow 'volume_create_manager' (cdb5c2df-cfc6-4156-aa11-db2f2ad82543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bf0564-29f0-48e1-a2d2-ac27d3ff11c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bf0564-29f0-48e1-a2d2-ac27d3ff11c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-436746697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9275a3ba-785b-48b8-8233-faee70faed35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aed40fc540443ebb22a6a4efee05852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:27Z,use_quota=True,user_id='9506a680def340b689d54557ea493237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04920eaa-b41f-40ba-ba69-f04c52458e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04920eaa-b41f-40ba-ba69-f04c52458e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f181707f-786a-457e-9e3b-c0e1be2ecfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f181707f-786a-457e-9e3b-c0e1be2ecfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9275a3ba-785b-48b8-8233-faee70faed35', 'volume_name': 'volume-9275a3ba-785b-48b8-8233-faee70faed35', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce2e029-88c9-43d4-a42b-abe1a29cabba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce2e029-88c9-43d4-a42b-abe1a29cabba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed9aa43-d36b-4235-9c68-66da5664f46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:27 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Volume 9275a3ba-785b-48b8-8233-faee70faed35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9275a3ba-785b-48b8-8233-faee70faed35', 'volume_size': 1} Apr 29 09:08:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:28 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" returned: 0 in 0.695s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-436746697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9275a3ba-785b-48b8-8233-faee70faed35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aed40fc540443ebb22a6a4efee05852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:27Z,use_quota=True,user_id='9506a680def340b689d54557ea493237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Creating volume 9275a3ba-785b-48b8-8233-faee70faed35 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:28 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4a2b5d-36fb-4ec8-b182-8cc0b2135e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:28 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 1073741824 Apr 29 09:08:28 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f32b16-f3c9-4068-a325-f23630b5713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:28 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Volume volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 (a9f3bc12-0ed4-4668-bcbf-fe52d8195853): created successfully Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f32b16-f3c9-4068-a325-f23630b5713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Flow 'volume_create_manager' (f0843ffb-81bb-4665-9b00-7a34ca2e6f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:28 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-08a47756-b1a7-44c7-b2f0-d6e48065713e tempest-VolumesDeleteCascade-1670486250 None] Created volume successfully. Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:29 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 1073741824" returned: 0 in 1.115s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:29 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 Apr 29 09:08:29 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:29 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35" returned: 0 in 0.638s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.743s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed9aa43-d36b-4235-9c68-66da5664f46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9275a3ba-785b-48b8-8233-faee70faed35', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4306cfa-6cfb-490e-9655-0556aaead8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Creating offline snapshot e8629e3b-bfde-4d45-8199-e2d79ef1a0fc of volume a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:08:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Volume volume-9275a3ba-785b-48b8-8233-faee70faed35 (9275a3ba-785b-48b8-8233-faee70faed35): created successfully Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4306cfa-6cfb-490e-9655-0556aaead8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Flow 'volume_create_manager' (cdb5c2df-cfc6-4156-aa11-db2f2ad82543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f4e0c7-93b4-47e8-98fa-38f2b34a91ad]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-493c214b-ae15-4933-912c-6e540594acf8 tempest-VolumeQuotasAdminTestJSON-785284720 None] Created volume successfully. Apr 29 09:08:30 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 Apr 29 09:08:30 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:30 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" returned: 0 in 0.851s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:30 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc 1G Apr 29 09:08:30 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:31 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc 1G" returned: 0 in 0.871s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c82b33d4-935f-4677-a734-1b51639a0926 tempest-VolumeQuotasAdminTestJSON-1184191923 None] Transfer volume completed successfully. Apr 29 09:08:31 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc Apr 29 09:08:31 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9900d02c-325f-43f2-a9b1-eab469505b56 tempest-GroupsTest-546462547 None] Group tempest-Group1-1143532760: creating Apr 29 09:08:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9900d02c-325f-43f2-a9b1-eab469505b56 tempest-GroupsTest-546462547 None] Group tempest-Group1-1143532760: created successfully Apr 29 09:08:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9900d02c-325f-43f2-a9b1-eab469505b56 tempest-GroupsTest-546462547 None] Create group completed successfully. Apr 29 09:08:32 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" returned: 0 in 1.021s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:32 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc is being set with open permissions: ugo+rw Apr 29 09:08:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:32 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc Apr 29 09:08:32 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Acquiring lock "cinder-9275a3ba-785b-48b8-8233-faee70faed35-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Lock "cinder-9275a3ba-785b-48b8-8233-faee70faed35-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Acquiring lock "cinder-quobyte-9275a3ba-785b-48b8-8233-faee70faed35" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Lock "cinder-quobyte-9275a3ba-785b-48b8-8233-faee70faed35" acquired by "delete_volume" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a8a7d8-fd16-4a64-b21d-328f236af31b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:33 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 Apr 29 09:08:33 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:33 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" returned: 0 in 0.813s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:33 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.info Apr 29 09:08:33 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-050578aa-8ffe-46d5-b2af-d0d22a59f482 tempest-GroupsTest-546462547 None] Group tempest-Group2-1053264526: creating Apr 29 09:08:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-050578aa-8ffe-46d5-b2af-d0d22a59f482 tempest-GroupsTest-546462547 None] Group tempest-Group2-1053264526: created successfully Apr 29 09:08:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-050578aa-8ffe-46d5-b2af-d0d22a59f482 tempest-GroupsTest-546462547 None] Create group completed successfully. Apr 29 09:08:34 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35" returned: 0 in 1.052s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:34 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35 Apr 29 09:08:34 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:34 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.info" returned: 0 in 0.782s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:34 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.info is being set with open permissions: ugo+rw Apr 29 09:08:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:34 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.info Apr 29 09:08:34 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:34 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9275a3ba-785b-48b8-8233-faee70faed35" returned: 0 in 0.830s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Lock "cinder-quobyte-9275a3ba-785b-48b8-8233-faee70faed35" released by "delete_volume" :: held 1.959s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Created reservations ['4c436625-0eef-492a-99da-8a3a906eda6a', '1b63c2ea-3318-46df-ad31-b67f985634bb', '80fd709b-4854-4850-8bc6-d9cda8e866be', '42cc8a19-1413-47c5-b27e-d7296b6c2463'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:35 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.info" returned: 0 in 0.826s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:35 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:35 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.307s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:35 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5bbb63ce-ca95-4ca8-a32d-490e11a41cef tempest-VolumesDeleteCascade-1670486250 None] Create snapshot completed successfully Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Flow 'volume_create_manager' (34a94810-5cc6-4203-90a1-07c3a801a7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b268336-5d6e-45db-9135-bc55d7e5dd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b268336-5d6e-45db-9135-bc55d7e5dd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1692421083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0f75e80-18ad-4768-be2e-f45b1f9b6fbf,host='devstack@QuobyteHD#QuobyteHD',id=1e00d58d-ec43-4553-b0ae-67bab1031816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8173f91765644b5eb71bf54fc60fc0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:36Z,use_quota=True,user_id='7c9f2062ca5c44b0b33cc3c9229125f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7d680c1-9daf-47fd-b4d8-9e969c719d7d),volume_type_id=c7d680c1-9daf-47fd-b4d8-9e969c719d7d)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fe8ad0-32c0-458d-be91-060f49cee91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fe8ad0-32c0-458d-be91-060f49cee91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9348ec-3213-4c45-8287-151c6cfcdaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9348ec-3213-4c45-8287-151c6cfcdaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e00d58d-ec43-4553-b0ae-67bab1031816', 'volume_name': 'volume-1e00d58d-ec43-4553-b0ae-67bab1031816', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c85cb2-1a06-4e4b-aadc-ca0813f8fcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c85cb2-1a06-4e4b-aadc-ca0813f8fcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6a12d4-ccc1-4067-961e-fd07d28b0049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:35 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Volume 1e00d58d-ec43-4553-b0ae-67bab1031816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e00d58d-ec43-4553-b0ae-67bab1031816', 'volume_size': 1} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0f75e80-18ad-4768-be2e-f45b1f9b6fbf,created_at=2026-04-29T07:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1692421083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0f75e80-18ad-4768-be2e-f45b1f9b6fbf,host='devstack@QuobyteHD#QuobyteHD',id=1e00d58d-ec43-4553-b0ae-67bab1031816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8173f91765644b5eb71bf54fc60fc0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:36Z,use_quota=True,user_id='7c9f2062ca5c44b0b33cc3c9229125f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7d680c1-9daf-47fd-b4d8-9e969c719d7d),volume_type_id=c7d680c1-9daf-47fd-b4d8-9e969c719d7d)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Creating volume 1e00d58d-ec43-4553-b0ae-67bab1031816 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:35 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:35 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 1073741824 Apr 29 09:08:35 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:36 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.911s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Deleted volume successfully. Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3571b09e-9961-4288-ac46-5cc157b8b6d7 tempest-VolumeQuotasAdminTestJSON-718603185 None] Lock "cinder-9275a3ba-785b-48b8-8233-faee70faed35-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Flow 'volume_create_manager' (33651e12-5b7c-48e8-a710-907a1a41ac4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55805131-ffe4-4c6a-9f87-1ddf78fd1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55805131-ffe4-4c6a-9f87-1ddf78fd1e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-741156798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e67c78-383d-48fb-866a-88af56986204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b10478fb5c49b683deb9e2618a7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8629e3b-bfde-4d45-8199-e2d79ef1a0fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:37Z,use_quota=True,user_id='41c7ca2aab0d47d79d91e77c9fd47299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e42b868-3b81-4d5b-978c-35f6e000116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e42b868-3b81-4d5b-978c-35f6e000116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560bef0c-2eb0-435c-88b3-200f1acb2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560bef0c-2eb0-435c-88b3-200f1acb2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13e67c78-383d-48fb-866a-88af56986204', 'volume_name': 'volume-13e67c78-383d-48fb-866a-88af56986204', 'volume_size': 1, 'snapshot_id': 'e8629e3b-bfde-4d45-8199-e2d79ef1a0fc'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b84d2d-cddc-432f-bdd0-a240e2be9d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b84d2d-cddc-432f-bdd0-a240e2be9d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c883abab-7663-491e-85fc-7a2529a3f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:36 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Volume 13e67c78-383d-48fb-866a-88af56986204: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13e67c78-383d-48fb-866a-88af56986204', 'volume_size': 1, 'snapshot_id': 'e8629e3b-bfde-4d45-8199-e2d79ef1a0fc'} Apr 29 09:08:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:37 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 1073741824" returned: 0 in 1.286s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:37 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 Apr 29 09:08:37 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:38 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816" returned: 0 in 1.011s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] <== create_volume: return (2350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.324s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc-13e67c78-383d-48fb-866a-88af56986204" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6a12d4-ccc1-4067-961e-fd07d28b0049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e00d58d-ec43-4553-b0ae-67bab1031816', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756246bc-0963-46df-a4b0-95c1e1d1fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc-13e67c78-383d-48fb-866a-88af56986204" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Creating volume 13e67c78-383d-48fb-866a-88af56986204 from snapshot e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-13e67c78-383d-48fb-866a-88af56986204" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:38 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Volume volume-1e00d58d-ec43-4553-b0ae-67bab1031816 (1e00d58d-ec43-4553-b0ae-67bab1031816): created successfully Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756246bc-0963-46df-a4b0-95c1e1d1fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Flow 'volume_create_manager' (34a94810-5cc6-4203-90a1-07c3a801a7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-13e67c78-383d-48fb-866a-88af56986204" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] snapshot: e8629e3b-bfde-4d45-8199-e2d79ef1a0fc, volume: 13e67c78-383d-48fb-866a-88af56986204, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:38 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0d8e88d4-25e4-4726-8a3f-de07a2f8bee8 tempest-GroupsTest-546462547 None] Created volume successfully. Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bef8be-3591-4384-920f-9c3de06899d5]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:38 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc Apr 29 09:08:38 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:39 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" returned: 0 in 1.241s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:08:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:08:39 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d07a7a-afa7-4091-af12-6e70b3267141]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:39 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 Apr 29 09:08:39 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Acquiring lock "cinder-quobyte-1e00d58d-ec43-4553-b0ae-67bab1031816" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Lock "cinder-quobyte-1e00d58d-ec43-4553-b0ae-67bab1031816" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:40 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7129f7c-6d80-4e54-addf-a832ce15087d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:40 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 Apr 29 09:08:40 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:40 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" returned: 0 in 1.149s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:40 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:08:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:40 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 Apr 29 09:08:40 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:41 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816" returned: 0 in 1.204s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:41 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816 Apr 29 09:08:41 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:42 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1e00d58d-ec43-4553-b0ae-67bab1031816" returned: 0 in 1.683s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Lock "cinder-quobyte-1e00d58d-ec43-4553-b0ae-67bab1031816" released by "delete_volume" :: held 2.970s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Created reservations ['99c257f4-9925-41b2-8851-6c1e21b65fc0'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:43 devstack cinder-volume[84004]: WARNING cinder.quota [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1365916675 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1365916675, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:08:43 devstack cinder-volume[84004]: WARNING cinder.quota [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1365916675 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1365916675, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Created reservations ['46a2388c-a85a-40bc-bb20-339981abf3d3', '518f498c-aeef-4bed-8c14-163d5a5e0f38', '490f36f4-f410-4e71-9e97-19f23a3c7aeb', '4c79e674-48ae-4be3-a2ce-ac7f5ae7dff7'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:43 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:43 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:44 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Created reservations ['74c1a8da-a0b5-423d-86f1-152f900f4dff'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:44 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:44 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:45 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.917s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:45 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:45 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-89105121-964c-4391-afb1-f20c44b9febd tempest-GroupsTest-546462547 None] Delete group completed successfully. Apr 29 09:08:45 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.827s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:45 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:45 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a7c61725-e41c-4bc6-a0d7-5d8ab19bd8ac tempest-GroupsTest-546462547 None] Delete group completed successfully. Apr 29 09:08:47 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-eb731fcf-048a-4c48-80e2-25ee57bc8a9e tempest-GroupsTest-546462547 None] Group tempest-GroupsTest-Group-393496306: creating Apr 29 09:08:47 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-eb731fcf-048a-4c48-80e2-25ee57bc8a9e tempest-GroupsTest-546462547 None] Group tempest-GroupsTest-Group-393496306: created successfully Apr 29 09:08:47 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-eb731fcf-048a-4c48-80e2-25ee57bc8a9e tempest-GroupsTest-546462547 None] Create group completed successfully. Apr 29 09:08:48 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-4bc2dc4d-e606-4682-99c0-235670589d70 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Terminate volume connection completed successfully. Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-4bc2dc4d-e606-4682-99c0-235670589d70 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Deleting attachment b9bb7583-12e3-4c21-bfd7-b909b30efa53. {{(pid=84004) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 09:08:48 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204" returned: 0 in 7.858s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3fa6c-74ef-4c03-999e-3614e873bf49]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "cinder-7d832de0-6c98-45ed-8801-005c14f2e4c9-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-7d832de0-6c98-45ed-8801-005c14f2e4c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "cinder-quobyte-7d832de0-6c98-45ed-8801-005c14f2e4c9" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:48 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 Apr 29 09:08:48 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-quobyte-7d832de0-6c98-45ed-8801-005c14f2e4c9" acquired by "delete_volume" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3df175c-e6f8-419d-9c88-ddac6f313f37]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Flow 'volume_create_manager' (bc52b107-d9b4-46c0-b598-bf1967eda4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62aa19a-7419-4f35-91e2-5521c30b1206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62aa19a-7419-4f35-91e2-5521c30b1206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781639304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e1653c2-f814-48b2-ba37-7d3d0d89b1f0,host='devstack@QuobyteHD#QuobyteHD',id=c14ba55a-ce66-4c11-8dca-3ed6c1a45b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8173f91765644b5eb71bf54fc60fc0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:49Z,use_quota=True,user_id='7c9f2062ca5c44b0b33cc3c9229125f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9ab1451-3a47-4687-aed5-c13c61b1dcda),volume_type_id=b9ab1451-3a47-4687-aed5-c13c61b1dcda)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76458b5-7e6b-4882-b919-8d8633e4f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76458b5-7e6b-4882-b919-8d8633e4f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0438f1bb-8c54-4531-9401-c4204277b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0438f1bb-8c54-4531-9401-c4204277b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14ba55a-ce66-4c11-8dca-3ed6c1a45b15', 'volume_name': 'volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:49 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:08:49 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2be741-d340-4125-9f2e-e33c7c426abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2be741-d340-4125-9f2e-e33c7c426abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb735f4-80bd-45e6-afb8-77995879609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:49 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Volume c14ba55a-ce66-4c11-8dca-3ed6c1a45b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15', 'volume_size': 1} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:49 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" returned: 0 in 1.114s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853, size 1024.00 MB, duration 7.86 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:08:49 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Converted 1024.00 MB image at 130.29 MB/s Apr 29 09:08:49 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 is being set with open permissions: ugo+rw Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:49 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 Apr 29 09:08:49 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:49 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 0 in 0.916s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:49 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:08:49 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Flow 'volume_create_manager' (9b73301e-20d7-4706-874c-5e816f2eebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f206e88d-0216-434c-80d4-895513bc2c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:50 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204" returned: 0 in 0.673s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f206e88d-0216-434c-80d4-895513bc2c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-787140380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc66d88e-320d-4d94-b974-b8631f61c4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1037828b1c485f823ce6a811938bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:50Z,use_quota=True,user_id='7e08609a04264bdd99ac8dd84012ee7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780b16c9-8606-4702-a426-b3dbfa886bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780b16c9-8606-4702-a426-b3dbfa886bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa20bf8-f188-45bd-8990-b3a7aa4f94eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa20bf8-f188-45bd-8990-b3a7aa4f94eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc66d88e-320d-4d94-b974-b8631f61c4a3', 'volume_name': 'volume-dc66d88e-320d-4d94-b974-b8631f61c4a3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84be13a-c66a-4180-b10f-2728c0f6ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84be13a-c66a-4180-b10f-2728c0f6ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e2a326-5ca0-4cdf-9856-7ed055e581d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:50 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Volume dc66d88e-320d-4d94-b974-b8631f61c4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc66d88e-320d-4d94-b974-b8631f61c4a3', 'volume_size': 1} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-13e67c78-383d-48fb-866a-88af56986204" released by "_copy_volume_from_snapshot" :: held 12.240s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc-13e67c78-383d-48fb-866a-88af56986204" released by "_create_volume_from_snapshot" :: held 12.309s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.355s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.400s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e1653c2-f814-48b2-ba37-7d3d0d89b1f0,created_at=2026-04-29T07:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781639304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e1653c2-f814-48b2-ba37-7d3d0d89b1f0,host='devstack@QuobyteHD#QuobyteHD',id=c14ba55a-ce66-4c11-8dca-3ed6c1a45b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8173f91765644b5eb71bf54fc60fc0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:49Z,use_quota=True,user_id='7c9f2062ca5c44b0b33cc3c9229125f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9ab1451-3a47-4687-aed5-c13c61b1dcda),volume_type_id=b9ab1451-3a47-4687-aed5-c13c61b1dcda)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Creating volume c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:50 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:50 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 1073741824 Apr 29 09:08:50 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c883abab-7663-491e-85fc-7a2529a3f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e67c78-383d-48fb-866a-88af56986204', 'volume_size': 1, 'snapshot_id': 'e8629e3b-bfde-4d45-8199-e2d79ef1a0fc'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994b3b96-d90a-4b6b-9bf1-a802336a2115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:50 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Volume volume-13e67c78-383d-48fb-866a-88af56986204 (13e67c78-383d-48fb-866a-88af56986204): created successfully Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994b3b96-d90a-4b6b-9bf1-a802336a2115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Flow 'volume_create_manager' (33651e12-5b7c-48e8-a710-907a1a41ac4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:50 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-be5bfe0a-a92f-4221-8d8d-c88ec3633339 tempest-VolumesDeleteCascade-1670486250 None] Created volume successfully. Apr 29 09:08:50 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 1 in 0.859s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:08:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:50 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9 Apr 29 09:08:50 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:51 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-7d832de0-6c98-45ed-8801-005c14f2e4c9" returned: 0 in 0.649s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-quobyte-7d832de0-6c98-45ed-8801-005c14f2e4c9" released by "delete_volume" :: held 2.538s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.quota [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Created reservations ['3518dfb0-658e-4f1d-894f-b985fe74715b', 'bf9e923f-e5b3-4e4f-b7a5-0c661716f165', '7f9ccbf4-09d9-4d8a-b6cd-a8e118c57e6a', 'c1beba52-a414-417f-b80a-d792d28b3bce'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-a9f3bc12-0ed4-4668-bcbf-fe52d8195853-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:51 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:51 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-a9f3bc12-0ed4-4668-bcbf-fe52d8195853-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Performing cascade delete. {{(pid=84004) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:51 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 1073741824" returned: 0 in 1.168s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Deleting offline snapshot e8629e3b-bfde-4d45-8199-e2d79ef1a0fc of volume a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:08:51 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 Apr 29 09:08:51 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] snapshot_file for this snap is: volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08753a-ddc0-434c-90f7-3f4e43984046]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:51 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc Apr 29 09:08:51 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:52 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.817s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.manager [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:52 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Deleted volume successfully. Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-9c5980ff-4fd4-4d9e-ae06-38a54c660c37 req-d54699e8-6caf-41b2-b0c4-b04afea19063 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-7d832de0-6c98-45ed-8801-005c14f2e4c9-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:52 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15" returned: 0 in 0.720s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-787140380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc66d88e-320d-4d94-b974-b8631f61c4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f1037828b1c485f823ce6a811938bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:50Z,use_quota=True,user_id='7e08609a04264bdd99ac8dd84012ee7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Creating volume dc66d88e-320d-4d94-b974-b8631f61c4a3 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:52 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:52 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 1073741824 Apr 29 09:08:52 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb735f4-80bd-45e6-afb8-77995879609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6815df09-b756-4557-9d2e-8eedf79a5f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:52 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Volume volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 (c14ba55a-ce66-4c11-8dca-3ed6c1a45b15): created successfully Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6815df09-b756-4557-9d2e-8eedf79a5f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Flow 'volume_create_manager' (bc52b107-d9b4-46c0-b598-bf1967eda4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:52 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-99eefdf4-bcdd-44a3-a297-312336e31fd4 tempest-GroupsTest-546462547 None] Created volume successfully. Apr 29 09:08:52 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" returned: 0 in 0.842s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[47715c14-94b9-4178-b05d-defa117ff978]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:52 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 Apr 29 09:08:52 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:53 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 1073741824" returned: 0 in 1.100s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:53 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 Apr 29 09:08:53 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:53 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" returned: 0 in 1.111s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:53 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc Apr 29 09:08:53 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Flow 'volume_create_manager' (92047e29-5674-497e-87f5-8261afc2370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5185ef1c-3c42-4469-9ba8-0376386481cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=150,cinder:SELECT=141,cinder:INSERT=37,cinder:DELETE=9 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5185ef1c-3c42-4469-9ba8-0376386481cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015435150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e1653c2-f814-48b2-ba37-7d3d0d89b1f0,host='devstack@QuobyteHD#QuobyteHD',id=0648e14a-71b1-4e44-93e7-680e1d65bd51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8173f91765644b5eb71bf54fc60fc0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='7c9f2062ca5c44b0b33cc3c9229125f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9ab1451-3a47-4687-aed5-c13c61b1dcda),volume_type_id=b9ab1451-3a47-4687-aed5-c13c61b1dcda)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a4632c-0afb-41c3-a2e6-084a4cff50be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a4632c-0afb-41c3-a2e6-084a4cff50be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220b5883-1f7d-452c-ae5c-c6af4d8a00ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220b5883-1f7d-452c-ae5c-c6af4d8a00ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0648e14a-71b1-4e44-93e7-680e1d65bd51', 'volume_name': 'volume-0648e14a-71b1-4e44-93e7-680e1d65bd51', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7385480-5db2-4c27-b5fb-f1517dcc6081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7385480-5db2-4c27-b5fb-f1517dcc6081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3a6683-7620-440e-b3fa-f7c933df30ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Volume 0648e14a-71b1-4e44-93e7-680e1d65bd51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0648e14a-71b1-4e44-93e7-680e1d65bd51', 'volume_size': 1} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3" returned: 0 in 0.777s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e1653c2-f814-48b2-ba37-7d3d0d89b1f0,created_at=2026-04-29T07:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1015435150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e1653c2-f814-48b2-ba37-7d3d0d89b1f0,host='devstack@QuobyteHD#QuobyteHD',id=0648e14a-71b1-4e44-93e7-680e1d65bd51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8173f91765644b5eb71bf54fc60fc0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:54Z,use_quota=True,user_id='7c9f2062ca5c44b0b33cc3c9229125f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9ab1451-3a47-4687-aed5-c13c61b1dcda),volume_type_id=b9ab1451-3a47-4687-aed5-c13c61b1dcda)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Creating volume 0648e14a-71b1-4e44-93e7-680e1d65bd51 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:08:54 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e2a326-5ca0-4cdf-9856-7ed055e581d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc66d88e-320d-4d94-b974-b8631f61c4a3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 1073741824 Apr 29 09:08:54 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00515454-c42e-4618-9ccb-caaa3c7dbced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:54 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Volume volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 (dc66d88e-320d-4d94-b974-b8631f61c4a3): created successfully Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00515454-c42e-4618-9ccb-caaa3c7dbced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Flow 'volume_create_manager' (9b73301e-20d7-4706-874c-5e816f2eebf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:54 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c6cb46a5-1969-42d7-b23a-125cc1be8f4f tempest-VolumeQuotasNegativeTestJSON-651681858 None] Created volume successfully. Apr 29 09:08:54 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" returned: 0 in 0.836s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:54 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc Apr 29 09:08:54 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:55 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853.e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" returned: 0 in 0.791s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc" released by "_delete_snapshot" :: held 3.716s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" released by "delete_snapshot" :: held 3.751s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:55 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 1073741824" returned: 0 in 1.129s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Created reservations ['ff65e494-8fe3-403e-a70b-0a141a4ff180', '02adc773-bab4-4a6f-9110-16b766905481', 'dba23183-2346-47b9-b6a6-6c8fa696ef89', 'cf080b98-9d9a-45a2-aef5-fc0c5f7a3b56'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:55 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 Apr 29 09:08:55 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:55 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Delete snapshot completed successfully. Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-e8629e3b-bfde-4d45-8199-e2d79ef1a0fc-delete_snapshot" released by "delete_snapshot" :: held 3.975s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Snapshots deleted, issuing volume delete {{(pid=84004) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[954e650e-3fea-46d1-8064-520176b49d17]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:55 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 Apr 29 09:08:55 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Acquiring lock "cinder-dc66d88e-320d-4d94-b974-b8631f61c4a3-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "cinder-dc66d88e-320d-4d94-b974-b8631f61c4a3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Acquiring lock "cinder-quobyte-dc66d88e-320d-4d94-b974-b8631f61c4a3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "cinder-quobyte-dc66d88e-320d-4d94-b974-b8631f61c4a3" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7a2dd4-829d-4884-814e-93c67aaa5097]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:56 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51" returned: 0 in 0.659s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:56 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 Apr 29 09:08:56 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3a6683-7620-440e-b3fa-f7c933df30ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0648e14a-71b1-4e44-93e7-680e1d65bd51', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4c9e75-eb3e-4a5f-a3ab-0963bcfe28c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:08:56 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Volume volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 (0648e14a-71b1-4e44-93e7-680e1d65bd51): created successfully Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4c9e75-eb3e-4a5f-a3ab-0963bcfe28c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Flow 'volume_create_manager' (92047e29-5674-497e-87f5-8261afc2370f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:08:56 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b24b90b7-c8c2-405d-bdbb-58a58ffb40bf tempest-GroupsTest-546462547 None] Created volume successfully. Apr 29 09:08:56 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" returned: 0 in 0.939s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:56 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853 Apr 29 09:08:56 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:56 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2d3b173e-a3ac-4463-b6cf-8be69ef90645 tempest-GroupsTest-546462547 None] Update group completed successfully. Apr 29 09:08:56 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3" returned: 0 in 0.719s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:56 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3 Apr 29 09:08:56 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:57 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" returned: 0 in 0.651s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-a9f3bc12-0ed4-4668-bcbf-fe52d8195853" released by "delete_volume" :: held 1.661s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Created reservations ['fe97a5de-ab08-4918-b10e-c2fa6ee34432', 'ef2d593a-8780-4a1f-bda9-fc4061621226', '4264b2b5-81f5-4c22-9a65-a810d975969f', '2c177a90-b5e1-478e-a2a1-a07e9c0e1f8c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:57 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:57 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:57 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dc66d88e-320d-4d94-b974-b8631f61c4a3" returned: 0 in 0.642s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "cinder-quobyte-dc66d88e-320d-4d94-b974-b8631f61c4a3" released by "delete_volume" :: held 1.402s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Created reservations ['efc444e1-c14f-469b-a024-1b5a53ca2973', '74f784eb-7e5c-49ef-ba35-c4dd51e8944c', '1368de8e-8e74-4e90-8feb-243aa48c0632', '1f42fcda-b9fb-4622-b242-657dc2b76f91'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:08:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:57 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:08:57 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-498b4560-21cb-4e5e-9fec-28afbfb51814 tempest-GroupsTest-546462547 None] Update group completed successfully. Apr 29 09:08:58 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.662s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Deleted volume successfully. Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5d66d2a0-d083-4d2d-b8c8-7413854e4ef6 tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-a9f3bc12-0ed4-4668-bcbf-fe52d8195853-delete_volume" released by "delete_volume" :: held 6.573s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-13e67c78-383d-48fb-866a-88af56986204-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:58 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.758s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:08:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Deleted volume successfully. Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-13e67c78-383d-48fb-866a-88af56986204-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=138,cinder:UPDATE=135,cinder:INSERT=40,cinder:DELETE=8 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-6af564f3-a2fa-4897-90c7-002bddd0655a tempest-VolumeQuotasNegativeTestJSON-651681858 None] Lock "cinder-dc66d88e-320d-4d94-b974-b8631f61c4a3-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "cinder-quobyte-13e67c78-383d-48fb-866a-88af56986204" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-13e67c78-383d-48fb-866a-88af56986204" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba33c6a6-f0ef-41ce-a87c-1f45049ecf35]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:58 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 Apr 29 09:08:58 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:59 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 29 09:08:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204" returned: 0 in 0.848s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:08:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:59 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204 Apr 29 09:08:59 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:08:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Acquiring lock "cinder-quobyte-0648e14a-71b1-4e44-93e7-680e1d65bd51" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:08:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Lock "cinder-quobyte-0648e14a-71b1-4e44-93e7-680e1d65bd51" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:08:59 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b769a-c6ce-4880-8c33-e371950028df]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:08:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:08:59 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 Apr 29 09:08:59 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:00 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e67c78-383d-48fb-866a-88af56986204" returned: 0 in 1.061s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-quobyte-13e67c78-383d-48fb-866a-88af56986204" released by "delete_volume" :: held 1.991s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Created reservations ['d58a932a-190d-42e6-9153-830daa31f7ea', '2d595a05-d445-4d05-8ed3-c9d350ee19bc', '73ee7fc9-1d0e-4916-8f9b-50e37f254c77', 'fb19fa0e-a93a-4225-a6e5-0e9c9a5c9a05'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:00 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51" returned: 0 in 1.342s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:00 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:00 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:00 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51 Apr 29 09:09:01 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:01 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.695s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Deleted volume successfully. Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d543e482-56d2-43ee-b865-92d2c1f02fbe tempest-VolumesDeleteCascade-1670486250 None] Lock "cinder-13e67c78-383d-48fb-866a-88af56986204-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:01 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0648e14a-71b1-4e44-93e7-680e1d65bd51" returned: 0 in 0.768s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Lock "cinder-quobyte-0648e14a-71b1-4e44-93e7-680e1d65bd51" released by "delete_volume" :: held 2.194s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Acquiring lock "cinder-quobyte-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Lock "cinder-quobyte-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15" acquired by "delete_volume" :: waited 0.037s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0631b5d9-d00d-4534-b9ac-463a7b245f6f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:02 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 Apr 29 09:09:02 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:02 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:02 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:02 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15" returned: 0 in 0.848s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:02 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15 Apr 29 09:09:02 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:02 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-a5305913-26d6-438d-87a4-647786b72dd3 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Terminate volume connection completed successfully. Apr 29 09:09:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-a5305913-26d6-438d-87a4-647786b72dd3 tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Deleting attachment 8c528f44-2a77-4398-a354-e8f2df2f1271. {{(pid=84004) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 09:09:03 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.892s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:03 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15" returned: 0 in 0.805s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Lock "cinder-quobyte-c14ba55a-ce66-4c11-8dca-3ed6c1a45b15" released by "delete_volume" :: held 1.730s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "cinder-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "cinder-quobyte-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-quobyte-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Created reservations ['587f7386-8ae2-4759-ab84-f3137ae09d63'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf08560-fcdc-4626-be0e-2dc12568b38d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:03 devstack cinder-volume[84004]: WARNING cinder.quota [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2008209677 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2008209677, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:09:03 devstack cinder-volume[84004]: WARNING cinder.quota [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2008209677 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2008209677, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:09:03 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Created reservations ['b09dd3b8-9f7f-4611-be05-e650c38dc3c4', '972cd2f0-9d41-4a64-b68e-74506f5f5a73', '691ec115-3fbb-4efb-9b38-9a57aac52f3c', '3a2ed579-800e-449c-8231-357b1e3057ec'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:03 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d Apr 29 09:09:03 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Created reservations ['cbe264d4-ab2e-4745-ae20-d699c5b91ffc', '0186d055-ae71-4fa3-baaa-937578b49c93', 'acf8d75f-f219-42b8-83fd-314aebd66318', 'f07614b6-cbaa-438c-af28-c49bfedbe58d'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:04 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:04 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:04 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d" returned: 0 in 1.012s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:04 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d Apr 29 09:09:04 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:04 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.795s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:04 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-670c0a83-0af1-4adb-9839-a44d67fbb9ae tempest-GroupsTest-546462547 None] Delete group completed successfully. Apr 29 09:09:05 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d" returned: 0 in 0.701s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-quobyte-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d" released by "delete_volume" :: held 1.781s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG cinder.quota [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Created reservations ['5169fbfe-a47e-4c19-9db3-a4bc8483fa41', '4d49de96-dbff-431c-86a6-a50fb0a10a4f', 'cf54882a-52f8-44f9-8a1e-20d51cb926e0', '13045971-1c8d-4b0c-8ad8-e91e04ccfa8f'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:05 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:05 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:06 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Flow 'volume_create_manager' (585e1f24-2843-4ce0-a487-89b1b258083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b53df1-6392-43eb-8c9f-a02fbbd15a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.843s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.manager [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b53df1-6392-43eb-8c9f-a02fbbd15a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1101146330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fb717d-c4c1-42b2-90b7-01ad2617ef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33652b0e91a64d939e675e2421dcfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:06Z,use_quota=True,user_id='293c9e5997b945aab701e6c6a1093053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23c08153-2007-4f6f-b2c5-b761541f9b6f),volume_type_id=23c08153-2007-4f6f-b2c5-b761541f9b6f)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99144907-4c7d-41a1-b499-c03eb5e4eef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99144907-4c7d-41a1-b499-c03eb5e4eef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de53532-4aa5-4937-af5f-3d1ae27c60c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de53532-4aa5-4937-af5f-3d1ae27c60c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88fb717d-c4c1-42b2-90b7-01ad2617ef1e', 'volume_name': 'volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc99275-ba7b-485a-9441-3e5cbe2fcdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc99275-ba7b-485a-9441-3e5cbe2fcdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070c44f1-f467-40cc-bf97-133fca211a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:06 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Volume 88fb717d-c4c1-42b2-90b7-01ad2617ef1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e', 'volume_size': 1} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1101146330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fb717d-c4c1-42b2-90b7-01ad2617ef1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33652b0e91a64d939e675e2421dcfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:06Z,use_quota=True,user_id='293c9e5997b945aab701e6c6a1093053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23c08153-2007-4f6f-b2c5-b761541f9b6f),volume_type_id=23c08153-2007-4f6f-b2c5-b761541f9b6f)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Creating volume 88fb717d-c4c1-42b2-90b7-01ad2617ef1e {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:06 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Deleted volume successfully. Apr 29 09:09:06 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e 1073741824 Apr 29 09:09:06 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-8ad293a4-b7a6-48cb-864e-71fe058bfe2b req-1f135565-d0db-4369-ac64-ee0f2f651fec tempest-ServerBootFromVolumeStableRescueTest-530427371 None] Lock "cinder-f6f458f9-dcc1-4391-a572-bafd0a8fbd6d-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:07 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e 1073741824" returned: 0 in 1.151s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:07 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e Apr 29 09:09:07 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:08 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e" returned: 0 in 0.712s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070c44f1-f467-40cc-bf97-133fca211a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5494609-ca24-46e6-8318-0910ca3d719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:08 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Volume volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e (88fb717d-c4c1-42b2-90b7-01ad2617ef1e): created successfully Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5494609-ca24-46e6-8318-0910ca3d719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Flow 'volume_create_manager' (585e1f24-2843-4ce0-a487-89b1b258083a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-dd1a858c-ceaf-4e89-9648-1d4c2f7e3595 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Created volume successfully. Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Flow 'volume_create_manager' (cfdfd240-bad4-4bf5-8e9e-da18dafa424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bd0ee0-4f0b-4c65-806f-5885cabb8b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bd0ee0-4f0b-4c65-806f-5885cabb8b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1449406161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19022e4-208a-411b-9f93-c4f05b4e6d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d29880f23a40da91bf9ee0861edece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:09Z,use_quota=True,user_id='e1f40c2c96bc47bdb79407ec77cb9e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47499b32-14df-4232-87b3-33c97d8f5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47499b32-14df-4232-87b3-33c97d8f5443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f71ed05-2ddd-4f5e-a58c-7eea8439f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f71ed05-2ddd-4f5e-a58c-7eea8439f56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19022e4-208a-411b-9f93-c4f05b4e6d49', 'volume_name': 'volume-c19022e4-208a-411b-9f93-c4f05b4e6d49', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbb7ead-8e7e-42d4-b9c2-b6f6c8542ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbb7ead-8e7e-42d4-b9c2-b6f6c8542ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995906ef-ae8c-453b-95e5-b10672bf446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:09 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Volume c19022e4-208a-411b-9f93-c4f05b4e6d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19022e4-208a-411b-9f93-c4f05b4e6d49', 'volume_size': 1} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1449406161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19022e4-208a-411b-9f93-c4f05b4e6d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d29880f23a40da91bf9ee0861edece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:09Z,use_quota=True,user_id='e1f40c2c96bc47bdb79407ec77cb9e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Creating volume c19022e4-208a-411b-9f93-c4f05b4e6d49 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:09 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:09 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 1073741824 Apr 29 09:09:09 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:10 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 1073741824" returned: 0 in 0.980s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:10 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 Apr 29 09:09:10 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:10 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:10 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:10 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49" returned: 0 in 0.745s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995906ef-ae8c-453b-95e5-b10672bf446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19022e4-208a-411b-9f93-c4f05b4e6d49', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c589dc6c-fd72-4f64-a43e-6228a4d6f6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:10 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Volume volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 (c19022e4-208a-411b-9f93-c4f05b4e6d49): created successfully Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c589dc6c-fd72-4f64-a43e-6228a4d6f6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Flow 'volume_create_manager' (cfdfd240-bad4-4bf5-8e9e-da18dafa424f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-07287ecf-c0eb-4cbc-8948-a5c92ceed9db tempest-VolumesTransfersV357Test-1516710348 None] Created volume successfully. Apr 29 09:09:11 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.744s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:11 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-77cefce9-58b6-450b-88b3-cdf8fbcdf751 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Retype volume completed successfully. Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Acquiring lock "cinder-88fb717d-c4c1-42b2-90b7-01ad2617ef1e-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:11 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4783ae4c-4c1b-4c77-bfa5-e7920c6728e6 tempest-VolumesTransfersV357Test-687738130 None] Transfer volume completed successfully. Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "cinder-88fb717d-c4c1-42b2-90b7-01ad2617ef1e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Acquiring lock "cinder-quobyte-88fb717d-c4c1-42b2-90b7-01ad2617ef1e" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "cinder-quobyte-88fb717d-c4c1-42b2-90b7-01ad2617ef1e" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9342eb08-7f0d-4c24-811e-26e02e5eabca]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:11 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e Apr 29 09:09:11 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:12 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e" returned: 0 in 0.769s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:12 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e Apr 29 09:09:12 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Acquiring lock "cinder-c19022e4-208a-411b-9f93-c4f05b4e6d49-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-c19022e4-208a-411b-9f93-c4f05b4e6d49-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Acquiring lock "cinder-quobyte-c19022e4-208a-411b-9f93-c4f05b4e6d49" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-quobyte-c19022e4-208a-411b-9f93-c4f05b4e6d49" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd8c28-919c-46f4-b681-c1cd17a723f9]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:13 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 Apr 29 09:09:13 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:13 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-88fb717d-c4c1-42b2-90b7-01ad2617ef1e" returned: 0 in 0.795s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "cinder-quobyte-88fb717d-c4c1-42b2-90b7-01ad2617ef1e" released by "delete_volume" :: held 1.612s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:13 devstack cinder-volume[84004]: WARNING cinder.quota [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:09:13 devstack cinder-volume[84004]: WARNING cinder.quota [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Created reservations ['63fcea48-a31f-43e8-ab16-3fc6402e8e2f', 'ea152e32-a1a6-402d-a9ea-cd3d0e3622dc', 'e1043b34-7f8e-4357-bb00-2a26432113d8', 'b54f4c7a-a407-4d26-b51b-b8309a12efe3'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:13 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:13 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:13 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49" returned: 0 in 0.765s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:13 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49 Apr 29 09:09:13 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:14 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.912s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:14 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:14 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Deleted volume successfully. Apr 29 09:09:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c1a047f8-3311-4f9e-a7a4-1bacf4810227 tempest-VolumeRetypeWithoutMigrationTest-2119825731 None] Lock "cinder-88fb717d-c4c1-42b2-90b7-01ad2617ef1e-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:14 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c19022e4-208a-411b-9f93-c4f05b4e6d49" returned: 0 in 0.990s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-quobyte-c19022e4-208a-411b-9f93-c4f05b4e6d49" released by "delete_volume" :: held 1.819s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:15 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Created reservations ['7c1b18f3-35e0-4656-8713-8bee898ef51c', 'c09c46f5-0bc6-40a0-b7d8-3d5e6b8ed4c2', 'b51a101a-f819-48c9-9d28-d9290e424780', 'b6e4eeb7-0e09-4885-acb9-67e39547c7f4'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:15 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:15 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:16 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.952s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:16 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Deleted volume successfully. Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Flow 'volume_create_manager' (309e4bf1-a005-49d2-b22c-8798a02e93dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97c9690-59cd-4978-be83-50e9bd9aa6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97c9690-59cd-4978-be83-50e9bd9aa6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-778477619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3176280-9768-4748-bc83-bfc7f7e0da37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d29880f23a40da91bf9ee0861edece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:16Z,use_quota=True,user_id='e1f40c2c96bc47bdb79407ec77cb9e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1026c122-e07c-4a44-8949-f416d6375582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1026c122-e07c-4a44-8949-f416d6375582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65c45e8-e57d-4090-ae06-eb89e3fa0115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65c45e8-e57d-4090-ae06-eb89e3fa0115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3176280-9768-4748-bc83-bfc7f7e0da37', 'volume_name': 'volume-e3176280-9768-4748-bc83-bfc7f7e0da37', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcf5d0b-099a-402e-8ed3-f27520a846e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcf5d0b-099a-402e-8ed3-f27520a846e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2f452f-6e20-470b-93c7-42cb60d5976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:16 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Volume e3176280-9768-4748-bc83-bfc7f7e0da37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3176280-9768-4748-bc83-bfc7f7e0da37', 'volume_size': 1} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-778477619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3176280-9768-4748-bc83-bfc7f7e0da37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d29880f23a40da91bf9ee0861edece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:16Z,use_quota=True,user_id='e1f40c2c96bc47bdb79407ec77cb9e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Creating volume e3176280-9768-4748-bc83-bfc7f7e0da37 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:16 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-25163da9-fb2f-465a-9d14-359162babebb tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-c19022e4-208a-411b-9f93-c4f05b4e6d49-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:16 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 1073741824 Apr 29 09:09:16 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:17 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 1073741824" returned: 0 in 0.947s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:17 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 Apr 29 09:09:17 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:17 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37" returned: 0 in 0.709s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2f452f-6e20-470b-93c7-42cb60d5976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3176280-9768-4748-bc83-bfc7f7e0da37', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3accb61-0508-40a9-b38e-0dba9c534812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:17 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Volume volume-e3176280-9768-4748-bc83-bfc7f7e0da37 (e3176280-9768-4748-bc83-bfc7f7e0da37): created successfully Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3accb61-0508-40a9-b38e-0dba9c534812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Flow 'volume_create_manager' (309e4bf1-a005-49d2-b22c-8798a02e93dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2c77545a-86db-417d-802d-07ff122835f3 tempest-VolumesTransfersV357Test-1516710348 None] Created volume successfully. Apr 29 09:09:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Acquiring lock "cinder-e3176280-9768-4748-bc83-bfc7f7e0da37-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-e3176280-9768-4748-bc83-bfc7f7e0da37-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Acquiring lock "cinder-quobyte-e3176280-9768-4748-bc83-bfc7f7e0da37" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-quobyte-e3176280-9768-4748-bc83-bfc7f7e0da37" acquired by "delete_volume" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:18 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[01285479-1de5-4329-a43c-9794188927b0]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:19 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 Apr 29 09:09:19 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:19 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37" returned: 0 in 1.032s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:19 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37 Apr 29 09:09:19 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:20 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3176280-9768-4748-bc83-bfc7f7e0da37" returned: 0 in 0.696s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-quobyte-e3176280-9768-4748-bc83-bfc7f7e0da37" released by "delete_volume" :: held 1.797s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Created reservations ['cb1e7550-ed4b-4acf-b29a-6c62f1beffa4', '8c65b5c3-0e84-4058-9257-931551774ddb', 'ee2027a0-d61a-4c58-a8d6-e68d76c7e6d7', 'e8c496ac-a74f-4d16-b597-7b06fb27cd50'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:20 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:20 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:21 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.640s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:21 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:21 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Deleted volume successfully. Apr 29 09:09:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5ba62ebd-3ba1-498b-b637-b6ee8bc99af9 tempest-VolumesTransfersV357Test-907424295 None] Lock "cinder-e3176280-9768-4748-bc83-bfc7f7e0da37-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Flow 'volume_create_manager' (a4c70bc4-c180-451e-80b1-3cddff40e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee6dec7-5d93-4ec0-85cb-09a8a972a178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee6dec7-5d93-4ec0-85cb-09a8a972a178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2088113704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11cb545-c30c-47a8-9138-82d464324046,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e345b912d28e47e1be7cddd9ca993188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:25Z,use_quota=True,user_id='dc6b46ec191548c9a0b21b1ad25784b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5b5392-c923-4c4c-8076-f957bccce25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5b5392-c923-4c4c-8076-f957bccce25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d410aedd-54e7-4dd7-a9c3-d25ec5503143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d410aedd-54e7-4dd7-a9c3-d25ec5503143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11cb545-c30c-47a8-9138-82d464324046', 'volume_name': 'volume-f11cb545-c30c-47a8-9138-82d464324046', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81040946-7530-482f-af55-9e95eec39b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81040946-7530-482f-af55-9e95eec39b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6db5ea7-047c-4523-ab26-fba8ec5bfd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:25 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Volume f11cb545-c30c-47a8-9138-82d464324046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11cb545-c30c-47a8-9138-82d464324046', 'volume_size': 1} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2088113704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11cb545-c30c-47a8-9138-82d464324046,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e345b912d28e47e1be7cddd9ca993188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:25Z,use_quota=True,user_id='dc6b46ec191548c9a0b21b1ad25784b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Creating volume f11cb545-c30c-47a8-9138-82d464324046 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:25 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:25 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 1073741824 Apr 29 09:09:25 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:26 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 1073741824" returned: 0 in 1.050s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:26 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 Apr 29 09:09:26 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:27 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046" returned: 0 in 0.738s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6db5ea7-047c-4523-ab26-fba8ec5bfd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11cb545-c30c-47a8-9138-82d464324046', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5d574d-0d49-4395-99b2-96f295748c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:27 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Volume volume-f11cb545-c30c-47a8-9138-82d464324046 (f11cb545-c30c-47a8-9138-82d464324046): created successfully Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5d574d-0d49-4395-99b2-96f295748c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Flow 'volume_create_manager' (a4c70bc4-c180-451e-80b1-3cddff40e866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:27 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-ec991cc6-5577-4c7b-888f-fbbd9f73e487 req-f0b257d3-6b5f-4584-bc30-4583257c3724 tempest-VolumesGetTestJSON-875471212 None] Created volume successfully. Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Acquiring lock "cinder-f11cb545-c30c-47a8-9138-82d464324046-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Lock "cinder-f11cb545-c30c-47a8-9138-82d464324046-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Acquiring lock "cinder-quobyte-f11cb545-c30c-47a8-9138-82d464324046" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Lock "cinder-quobyte-f11cb545-c30c-47a8-9138-82d464324046" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4fe957-d95e-4150-a6a8-3264f5f34f18]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:28 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 Apr 29 09:09:28 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:28 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046" returned: 0 in 0.828s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:28 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046 Apr 29 09:09:28 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:29 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f11cb545-c30c-47a8-9138-82d464324046" returned: 0 in 0.955s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Lock "cinder-quobyte-f11cb545-c30c-47a8-9138-82d464324046" released by "delete_volume" :: held 1.844s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG cinder.quota [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Created reservations ['0c5f3386-8c4c-4cda-b29f-6dd0d1638df8', 'a7d0e115-3e50-4b0e-8047-028a0a2b1247', '528c104b-cd92-49dc-a7a5-3164932f80ae', '1b73a923-7dee-45f6-8e8a-d340c20d69f7'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:29 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:29 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:31 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.122s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.manager [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Deleted volume successfully. Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [req-dce12746-2f8a-4b8c-bff7-715c63a3026c req-86ada28b-cee5-4154-ae96-519527be4007 tempest-VolumesGetTestJSON-875471212 None] Lock "cinder-f11cb545-c30c-47a8-9138-82d464324046-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Flow 'volume_create_manager' (b09af904-6768-4066-a21b-1acdd9f77f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649dce36-f137-4e97-bb39-c53dbcba3660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649dce36-f137-4e97-bb39-c53dbcba3660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-316965181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be39fdc-671c-433b-aad6-76905f2523df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ab2846db524b5895c2bbe73004a957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:31Z,use_quota=True,user_id='cfa061b213b24a489d645448c81a011e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f410be-936e-4cc9-bfb6-015fbc5bdc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f410be-936e-4cc9-bfb6-015fbc5bdc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b84169-c220-467f-bc6e-ba332cbc6f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.image.glance [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Creating Keystone auth plugin from conf {{(pid=84004) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b84169-c220-467f-bc6e-ba332cbc6f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4be39fdc-671c-433b-aad6-76905f2523df', 'volume_name': 'volume-4be39fdc-671c-433b-aad6-76905f2523df', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3079d127-c2b0-448a-aff3-0207b3265b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3079d127-c2b0-448a-aff3-0207b3265b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ddba8-f47f-4ca8-9a03-0b60a4f30221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:31 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Volume 4be39fdc-671c-433b-aad6-76905f2523df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4be39fdc-671c-433b-aad6-76905f2523df', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 09:09:31 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Trying to clone 4be39fdc-671c-433b-aad6-76905f2523df from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a at location (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]). {{(pid=84004) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 09:09:32 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 09:09:32 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Image download 20.69 MB at 20.69 MB/s Apr 29 09:09:32 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc2326-d21e-4902-b849-df1c047c5447]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:32 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD Apr 29 09:09:32 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:32 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:33 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a is fetched for user cfa061b213b24a489d645448c81a011e. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 09:09:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e6d1c-cb05-453e-96a3-140978b0d88b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:33 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD Apr 29 09:09:33 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:34 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD" returned: 0 in 1.020s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-316965181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be39fdc-671c-433b-aad6-76905f2523df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ab2846db524b5895c2bbe73004a957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:31Z,use_quota=True,user_id='cfa061b213b24a489d645448c81a011e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Creating volume 4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:34 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:34 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df 1073741824 Apr 29 09:09:34 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:35 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df 1073741824" returned: 0 in 0.951s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:35 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df Apr 29 09:09:35 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:36 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df" returned: 0 in 0.931s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:36 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Attempting download of 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume 4be39fdc-671c-433b-aad6-76905f2523df. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 09:09:36 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e69129-e4b6-41aa-9f3d-8f7e7bc2fb89]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_rr0wyymq {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:36 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_rr0wyymq Apr 29 09:09:36 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:37 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_rr0wyymq" returned: 0 in 0.964s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_rr0wyymq {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:37 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_rr0wyymq Apr 29 09:09:37 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:37 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_rr0wyymq" returned: 1 in 0.823s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_rr0wyymq' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:09:37 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d0fac-7f03-4b2f-a08e-69986ff839af]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:38 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD Apr 29 09:09:38 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:38 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:38 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] 94604fed-be0e-4d2f-b51a-4c6bf32c717a was qcow2, converting to raw {{(pid=84004) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 09:09:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:38 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df Apr 29 09:09:38 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Flow 'volume_create_manager' (043601db-8c38-4b8f-8305-59d9be865fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19aa9038-41ba-4697-93d8-6f6f77c2a6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19aa9038-41ba-4697-93d8-6f6f77c2a6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005755609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3e0eb4-63ae-463c-bab7-cc3c1b574a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc63d27eb8a24882a5005d12f750e214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:41Z,use_quota=True,user_id='27a77e3d68c247e7a582f451fe96041c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24ab2cd-f584-4008-a37c-05bcf0396026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24ab2cd-f584-4008-a37c-05bcf0396026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e800a8-b35c-4aae-85b2-7bb983650eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e800a8-b35c-4aae-85b2-7bb983650eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3e0eb4-63ae-463c-bab7-cc3c1b574a54', 'volume_name': 'volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba8c2e5-77e8-4c76-a0d1-f347a197d477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba8c2e5-77e8-4c76-a0d1-f347a197d477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2a787a-ee30-4a21-896c-6fcb0382cbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:41 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Volume ec3e0eb4-63ae-463c-bab7-cc3c1b574a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54', 'volume_size': 1} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005755609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3e0eb4-63ae-463c-bab7-cc3c1b574a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc63d27eb8a24882a5005d12f750e214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:41Z,use_quota=True,user_id='27a77e3d68c247e7a582f451fe96041c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Creating volume ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:41 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:41 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 1073741824 Apr 29 09:09:41 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:41 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df" returned: 0 in 2.641s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_fog8kbycdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:09:41 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Converted 112.00 MB image at 42.39 MB/s Apr 29 09:09:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:41 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df 1G Apr 29 09:09:41 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:42 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:42 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 1073741824" returned: 0 in 0.965s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df 1G" returned: 0 in 0.828s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66ca761-319e-43bd-a027-827376407130]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:42 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:09:42 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:42 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df Apr 29 09:09:42 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:43 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.778s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2a787a-ee30-4a21-896c-6fcb0382cbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc769284-1ac9-406d-9a67-e7496ec77551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:43 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Volume volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 (ec3e0eb4-63ae-463c-bab7-cc3c1b574a54): created successfully Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc769284-1ac9-406d-9a67-e7496ec77551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Flow 'volume_create_manager' (043601db-8c38-4b8f-8305-59d9be865fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:43 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:43 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fe3a883e-1142-4717-bce8-f2096a0d7f52 tempest-VolumesActionsTest-337901378 None] Created volume successfully. Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df" returned: 0 in 0.829s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:43 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df Apr 29 09:09:43 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:43 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df" returned: 1 in 0.758s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Downloaded image 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume 4be39fdc-671c-433b-aad6-76905f2523df successfully. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a for user cfa061b213b24a489d645448c81a011e is deleted. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 09:09:43 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Marking volume 4be39fdc-671c-433b-aad6-76905f2523df as bootable. {{(pid=84004) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 09:09:44 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Copying metadata from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a to 4be39fdc-671c-433b-aad6-76905f2523df. {{(pid=84004) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 09:09:44 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Creating volume glance metadata for volume 4be39fdc-671c-433b-aad6-76905f2523df backed by image 94604fed-be0e-4d2f-b51a-4c6bf32c717a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84004) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 09:09:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ddba8-f47f-4ca8-9a03-0b60a4f30221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be39fdc-671c-433b-aad6-76905f2523df', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2662aeb2-5194-4eca-aabc-c771014ca7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:44 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Volume volume-4be39fdc-671c-433b-aad6-76905f2523df (4be39fdc-671c-433b-aad6-76905f2523df): created successfully Apr 29 09:09:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2662aeb2-5194-4eca-aabc-c771014ca7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Flow 'volume_create_manager' (b09af904-6768-4066-a21b-1acdd9f77f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:44 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0ec3ef80-90e0-4091-8047-e412e2a495f1 tempest-VolumesImageMetadata-1596592987 None] Created volume successfully. Apr 29 09:09:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Acquiring lock "cinder-4be39fdc-671c-433b-aad6-76905f2523df-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Lock "cinder-4be39fdc-671c-433b-aad6-76905f2523df-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Acquiring lock "cinder-quobyte-4be39fdc-671c-433b-aad6-76905f2523df" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:09:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Lock "cinder-quobyte-4be39fdc-671c-433b-aad6-76905f2523df" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:09:45 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e39ad57-e856-479c-9c9b-33a62cbbc354]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:45 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df Apr 29 09:09:45 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:46 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df" returned: 0 in 0.796s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:46 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df Apr 29 09:09:46 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:47 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df" returned: 1 in 0.789s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:09:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:47 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df Apr 29 09:09:47 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:48 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4be39fdc-671c-433b-aad6-76905f2523df" returned: 0 in 0.765s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Lock "cinder-quobyte-4be39fdc-671c-433b-aad6-76905f2523df" released by "delete_volume" :: held 2.460s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Created reservations ['6bc82a7e-0629-4749-be40-4ff26a4b6ca9', '470d838d-47f7-4528-94f1-c85955d816b8', '1c961d70-8cb0-43da-92f5-2a1d06e58736', 'ffe7ae5d-f764-453f-ac41-0db5b965c6b8'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:48 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:09:48 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:49 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.697s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:49 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:09:49 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Deleted volume successfully. Apr 29 09:09:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cb3d4e5-adc8-4b92-b717-908693ac05b5 tempest-VolumesImageMetadata-1596592987 None] Lock "cinder-4be39fdc-671c-433b-aad6-76905f2523df-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Flow 'volume_create_manager' (9ea757ca-5d76-4b05-b55d-9459bffa65bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc5928-668b-4e32-b988-668f7cacd846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc5928-668b-4e32-b988-668f7cacd846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1084513784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591863fa-edd2-470e-9385-105a8ada54ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f2ed6cd3004434be621bf9907538a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:53Z,use_quota=True,user_id='34ffe5d2592f42c78cbf77314c125ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3beae9-4f60-4a60-b37d-40305a5ecfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3beae9-4f60-4a60-b37d-40305a5ecfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550713ed-0271-43bc-a33d-2e89cb9c1245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550713ed-0271-43bc-a33d-2e89cb9c1245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591863fa-edd2-470e-9385-105a8ada54ad', 'volume_name': 'volume-591863fa-edd2-470e-9385-105a8ada54ad', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b6336-851d-4f8e-ae9a-4c753e8b3b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b6336-851d-4f8e-ae9a-4c753e8b3b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13687c3e-f498-40eb-adff-f119f64c5f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:52 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Volume 591863fa-edd2-470e-9385-105a8ada54ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591863fa-edd2-470e-9385-105a8ada54ad', 'volume_size': 1} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1084513784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591863fa-edd2-470e-9385-105a8ada54ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f2ed6cd3004434be621bf9907538a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:53Z,use_quota=True,user_id='34ffe5d2592f42c78cbf77314c125ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Creating volume 591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:52 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:52 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad 1073741824 Apr 29 09:09:52 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:53 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad 1073741824" returned: 0 in 1.010s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:53 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad Apr 29 09:09:53 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:54 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad" returned: 0 in 0.762s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:DELETE=8,cinder:SELECT=103,cinder:INSERT=34,cinder:UPDATE=131 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13687c3e-f498-40eb-adff-f119f64c5f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591863fa-edd2-470e-9385-105a8ada54ad', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d492e-e61a-416f-8207-8656bb341450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:54 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Volume volume-591863fa-edd2-470e-9385-105a8ada54ad (591863fa-edd2-470e-9385-105a8ada54ad): created successfully Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d492e-e61a-416f-8207-8656bb341450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Flow 'volume_create_manager' (9ea757ca-5d76-4b05-b55d-9459bffa65bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:54 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-14173476-aac8-41f5-b129-d318b9b04ed1 tempest-SnapshotMetadataTestJSON-266575395 None] Created volume successfully. Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Creating offline snapshot 15fd9e6e-4b25-4969-b921-575cf47ad5a8 of volume 591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630bfb3-e8ab-4292-b029-805098d53764]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:55 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad Apr 29 09:09:55 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Flow 'volume_create_manager' (63ed407a-2aab-4956-a1fa-0c3f03dcc5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a746b8c9-7fe3-4f4f-a69b-75d52fc24eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a746b8c9-7fe3-4f4f-a69b-75d52fc24eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1221237037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d19655-5a62-4277-aeea-2710a216ff74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65fc728c826546558401dd509fddf727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:56Z,use_quota=True,user_id='f47a91ff806745aaa4658e794607cc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e9eb05-a501-444d-83de-74fa88f23ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e9eb05-a501-444d-83de-74fa88f23ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af173ae3-89c8-4b21-bde7-ca19d78c7977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af173ae3-89c8-4b21-bde7-ca19d78c7977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d19655-5a62-4277-aeea-2710a216ff74', 'volume_name': 'volume-44d19655-5a62-4277-aeea-2710a216ff74', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9756335-22eb-4364-ab6a-9ac5db37f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9756335-22eb-4364-ab6a-9ac5db37f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a03b805-1aed-49ac-b45b-4d74318f9a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:09:55 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Volume 44d19655-5a62-4277-aeea-2710a216ff74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d19655-5a62-4277-aeea-2710a216ff74', 'volume_size': 1} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:55 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad" returned: 0 in 0.765s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:55 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 1G Apr 29 09:09:55 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:56 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 1G" returned: 0 in 0.993s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-591863fa-edd2-470e-9385-105a8ada54ad -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:56 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-591863fa-edd2-470e-9385-105a8ada54ad -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 Apr 29 09:09:56 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:57 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-591863fa-edd2-470e-9385-105a8ada54ad -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8" returned: 0 in 0.650s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:57 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 is being set with open permissions: ugo+rw Apr 29 09:09:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:57 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 Apr 29 09:09:57 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:58 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8" returned: 0 in 0.633s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:58 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.info Apr 29 09:09:58 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:58 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.info" returned: 0 in 0.592s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:58 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.info is being set with open permissions: ugo+rw Apr 29 09:09:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:58 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.info Apr 29 09:09:58 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:59 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.info" returned: 0 in 1.028s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.775s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1221237037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d19655-5a62-4277-aeea-2710a216ff74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65fc728c826546558401dd509fddf727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:56Z,use_quota=True,user_id='f47a91ff806745aaa4658e794607cc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Creating volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:09:59 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:09:59 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=80,cinder:UPDATE=104,cinder:INSERT=32,cinder:DELETE=7 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:09:59 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 1073741824 Apr 29 09:09:59 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:09:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8e8417f1-f48d-45d8-a3b1-39804ae3af05 tempest-SnapshotMetadataTestJSON-266575395 None] Create snapshot completed successfully Apr 29 09:10:01 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 1073741824" returned: 0 in 1.137s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:01 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 Apr 29 09:10:01 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "cinder-15fd9e6e-4b25-4969-b921-575cf47ad5a8-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-15fd9e6e-4b25-4969-b921-575cf47ad5a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "cinder-quobyte-591863fa-edd2-470e-9385-105a8ada54ad" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-quobyte-591863fa-edd2-470e-9385-105a8ada54ad" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "cinder-quobyte-15fd9e6e-4b25-4969-b921-575cf47ad5a8" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-quobyte-15fd9e6e-4b25-4969-b921-575cf47ad5a8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Deleting offline snapshot 15fd9e6e-4b25-4969-b921-575cf47ad5a8 of volume 591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] snapshot_file for this snap is: volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908285b-a2f0-41f6-9817-89e9415ed45c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:01 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 Apr 29 09:10:01 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:02 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74" returned: 0 in 1.000s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a03b805-1aed-49ac-b45b-4d74318f9a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d19655-5a62-4277-aeea-2710a216ff74', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1940f30b-3538-4e75-b036-810c5dd2f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:02 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Volume volume-44d19655-5a62-4277-aeea-2710a216ff74 (44d19655-5a62-4277-aeea-2710a216ff74): created successfully Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1940f30b-3538-4e75-b036-810c5dd2f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Flow 'volume_create_manager' (63ed407a-2aab-4956-a1fa-0c3f03dcc5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:02 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-29e912ee-b344-49d0-83d3-2dd3452f3eba tempest-SnapshotsActionsTest-1292474880 None] Created volume successfully. Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:02 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:10:02 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Creating offline snapshot 7449de81-320e-47bf-aa6f-9e5c58996300 of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[76795275-d45b-4c99-83c0-b17894461891]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:02 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8" returned: 0 in 1.461s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-591863fa-edd2-470e-9385-105a8ada54ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:03 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e77fb-ab37-4dea-b183-c908ae4f0364]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:03 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 Apr 29 09:10:03 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:03 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad Apr 29 09:10:03 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:03 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.200s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8082b6dc-f0b4-4bb0-8e38-0c86965b29b3 tempest-VolumesActionsTest-337901378 None] Acquiring lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" by "attach_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8082b6dc-f0b4-4bb0-8e38-0c86965b29b3 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" acquired by "attach_volume" :: waited 0.037s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8082b6dc-f0b4-4bb0-8e38-0c86965b29b3 tempest-VolumesActionsTest-337901378 None] Attaching volume ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 to instance 009a7e3b-ab5e-4bd1-9b5b-e7c1ced73203 at mountpoint /dev/vdb on host None. Apr 29 09:10:04 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:04 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74" returned: 0 in 1.511s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad" returned: 0 in 1.473s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:04 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 1G Apr 29 09:10:04 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:04 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 Apr 29 09:10:04 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8082b6dc-f0b4-4bb0-8e38-0c86965b29b3 tempest-VolumesActionsTest-337901378 None] Attach volume completed successfully. Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8082b6dc-f0b4-4bb0-8e38-0c86965b29b3 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" released by "attach_volume" :: held 0.398s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0c08d467-96b0-40cd-a2f8-d9ccb6ea79d6 tempest-VolumesActionsTest-337901378 None] Acquiring lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-detach_volume" by "detach_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0c08d467-96b0-40cd-a2f8-d9ccb6ea79d6 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0c08d467-96b0-40cd-a2f8-d9ccb6ea79d6 tempest-VolumesActionsTest-337901378 None] Detaching volume ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 from instance 009a7e3b-ab5e-4bd1-9b5b-e7c1ced73203. Apr 29 09:10:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0c08d467-96b0-40cd-a2f8-d9ccb6ea79d6 tempest-VolumesActionsTest-337901378 None] Detach volume completed successfully. Apr 29 09:10:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0c08d467-96b0-40cd-a2f8-d9ccb6ea79d6 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:05 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 1G" returned: 0 in 1.020s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:05 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:05 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:05 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8" returned: 0 in 1.077s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:05 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8 Apr 29 09:10:05 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:06 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.988s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:06 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 is being set with open permissions: ugo+rw Apr 29 09:10:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:06 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:06 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:06 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad.15fd9e6e-4b25-4969-b921-575cf47ad5a8" returned: 0 in 0.992s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-quobyte-15fd9e6e-4b25-4969-b921-575cf47ad5a8" released by "_delete_snapshot" :: held 5.198s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-quobyte-591863fa-edd2-470e-9385-105a8ada54ad" released by "delete_snapshot" :: held 5.230s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:06 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Created reservations ['5b2fea9f-31d2-4dd2-9f43-45f830cb6f39', '348fba31-3925-467b-aa6a-ac0cc28c57fa', 'b09afab4-842a-4396-aa05-4bfbc0e0b78a', '71251b15-b6a6-48bc-bc47-1a99defb8c0d'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Delete snapshot completed successfully. Apr 29 09:10:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-63a2937f-2362-4cc0-bdd2-9e6df7960f76 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-15fd9e6e-4b25-4969-b921-575cf47ad5a8-delete_snapshot" released by "delete_snapshot" :: held 5.441s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:07 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.811s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:07 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.info Apr 29 09:10:07 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "cinder-591863fa-edd2-470e-9385-105a8ada54ad-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-591863fa-edd2-470e-9385-105a8ada54ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:07 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.info" returned: 0 in 0.615s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:07 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.info is being set with open permissions: ugo+rw Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "cinder-quobyte-591863fa-edd2-470e-9385-105a8ada54ad" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:07 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.info Apr 29 09:10:07 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-quobyte-591863fa-edd2-470e-9385-105a8ada54ad" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b05b80-b0ec-44a5-9a09-7825aec8526d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:08 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad Apr 29 09:10:08 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:08 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.info" returned: 0 in 0.577s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.675s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-cc9b091f-50b0-4995-b071-9aba902e6dca tempest-SnapshotsActionsTest-1292474880 None] Create snapshot completed successfully Apr 29 09:10:08 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad" returned: 0 in 0.823s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:08 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad Apr 29 09:10:08 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:09 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-591863fa-edd2-470e-9385-105a8ada54ad" returned: 0 in 0.612s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-quobyte-591863fa-edd2-470e-9385-105a8ada54ad" released by "delete_volume" :: held 1.496s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Created reservations ['6615767c-3447-4737-99d5-5273ab54cffa', '61b2e332-46a7-4736-b2d6-750c0a7e6538', 'd4bfb430-3b51-44e1-8db5-54ea8c4a02c7', '545d9cb9-177a-4650-be03-e781ffd4b244'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:09 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:10:09 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Creating offline snapshot 6427dffe-8565-49bf-ac67-d29b84818d2d of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1943ea-67d4-471f-bc6c-b0fd6c0b915c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:09 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:09 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:10 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.675s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:10 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Deleted volume successfully. Apr 29 09:10:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32772f0c-fb46-46ef-b8d4-270f38828824 tempest-SnapshotMetadataTestJSON-266575395 None] Lock "cinder-591863fa-edd2-470e-9385-105a8ada54ad-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:10 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.834s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:10 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d 1G Apr 29 09:10:10 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:11 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d 1G" returned: 0 in 1.018s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:11 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d Apr 29 09:10:11 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:12 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d" returned: 0 in 0.913s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:12 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d is being set with open permissions: ugo+rw Apr 29 09:10:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:12 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d Apr 29 09:10:12 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:13 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d" returned: 0 in 0.683s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.592s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d53b946a-1cbc-4d67-9082-3426dd0c141f tempest-SnapshotsActionsTest-1292474880 None] Create snapshot completed successfully Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Flow 'volume_create_manager' (7959fc4a-2fda-473b-b9f6-c7eac81e2f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0444581e-355f-4874-ba31-81aff0aab831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0444581e-355f-4874-ba31-81aff0aab831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-577552823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70c24f0-538c-43a4-aac0-333925901f4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d294b3572a1407090a789602b9c2c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:14Z,use_quota=True,user_id='fb935237f71c4189b8870361b2b8f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d4941a-1d95-46cf-9823-4007b66efe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d4941a-1d95-46cf-9823-4007b66efe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38573487-faca-437e-a4b7-fce8a2d95221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38573487-faca-437e-a4b7-fce8a2d95221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70c24f0-538c-43a4-aac0-333925901f4a', 'volume_name': 'volume-b70c24f0-538c-43a4-aac0-333925901f4a', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdae7734-90c5-42e1-807f-3ebaea24b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdae7734-90c5-42e1-807f-3ebaea24b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12bfd6c-ad05-44c1-b75d-dad6d60d258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:14 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Volume b70c24f0-538c-43a4-aac0-333925901f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70c24f0-538c-43a4-aac0-333925901f4a', 'volume_size': 1} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-577552823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70c24f0-538c-43a4-aac0-333925901f4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d294b3572a1407090a789602b9c2c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:14Z,use_quota=True,user_id='fb935237f71c4189b8870361b2b8f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Creating volume b70c24f0-538c-43a4-aac0-333925901f4a {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:14 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:14 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a 1073741824 Apr 29 09:10:14 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-6427dffe-8565-49bf-ac67-d29b84818d2d-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-6427dffe-8565-49bf-ac67-d29b84818d2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-6427dffe-8565-49bf-ac67-d29b84818d2d" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-6427dffe-8565-49bf-ac67-d29b84818d2d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Deleting offline snapshot 6427dffe-8565-49bf-ac67-d29b84818d2d of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] snapshot_file for this snap is: volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b9ba2f-c6a5-4960-a674-ed41bb678239]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:14 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d Apr 29 09:10:14 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:14 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a 1073741824" returned: 0 in 0.966s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:15 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a Apr 29 09:10:15 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:15 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d" returned: 0 in 1.044s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[27994436-c8d1-47b9-a776-158e2f79b618]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:15 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:15 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:15 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a" returned: 0 in 0.730s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12bfd6c-ad05-44c1-b75d-dad6d60d258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70c24f0-538c-43a4-aac0-333925901f4a', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a937e1-7209-403e-83ba-24db9244c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:15 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Volume volume-b70c24f0-538c-43a4-aac0-333925901f4a (b70c24f0-538c-43a4-aac0-333925901f4a): created successfully Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a937e1-7209-403e-83ba-24db9244c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Flow 'volume_create_manager' (7959fc4a-2fda-473b-b9f6-c7eac81e2f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:15 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d3cf324e-8554-4a1e-8500-93ea9708e929 tempest-VolumesListTestJSON-318241000 None] Created volume successfully. Apr 29 09:10:16 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.782s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:16 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d Apr 29 09:10:16 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Flow 'volume_create_manager' (fb94edbe-6399-45dc-98a6-873b2faffd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959b3290-01f9-47e7-88a2-e31354f8f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959b3290-01f9-47e7-88a2-e31354f8f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-819051259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3bacda-6d24-491b-9a05-821e4d916299,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d294b3572a1407090a789602b9c2c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:17Z,use_quota=True,user_id='fb935237f71c4189b8870361b2b8f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837bbbd5-b9d5-4982-aec5-824bb56347f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837bbbd5-b9d5-4982-aec5-824bb56347f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d530e5c-d120-4186-a52c-456ac5d8d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d530e5c-d120-4186-a52c-456ac5d8d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce3bacda-6d24-491b-9a05-821e4d916299', 'volume_name': 'volume-ce3bacda-6d24-491b-9a05-821e4d916299', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8be801-8a72-4e12-8449-018f75700c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8be801-8a72-4e12-8449-018f75700c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828a1dcb-d867-43bf-9bd7-a6d881587c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:16 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Volume ce3bacda-6d24-491b-9a05-821e4d916299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce3bacda-6d24-491b-9a05-821e4d916299', 'volume_size': 1} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-819051259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3bacda-6d24-491b-9a05-821e4d916299,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d294b3572a1407090a789602b9c2c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:17Z,use_quota=True,user_id='fb935237f71c4189b8870361b2b8f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Creating volume ce3bacda-6d24-491b-9a05-821e4d916299 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:16 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:16 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 1073741824 Apr 29 09:10:16 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:16 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d" returned: 0 in 0.848s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:16 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d Apr 29 09:10:16 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:17 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 1073741824" returned: 0 in 0.822s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:17 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.6427dffe-8565-49bf-ac67-d29b84818d2d" returned: 0 in 0.597s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-6427dffe-8565-49bf-ac67-d29b84818d2d" released by "_delete_snapshot" :: held 3.413s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" released by "delete_snapshot" :: held 3.443s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:17 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 Apr 29 09:10:17 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:17 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Created reservations ['73f18d69-1162-45c2-a177-20bc7d9e8905', '29e44d26-1306-444a-9312-3f1b84e789c4', 'c7c25b46-80ef-479b-8b49-67969f9b4c5d', 'f78adfc2-323d-4f6a-9b9f-6e4d60095ae4'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Delete snapshot completed successfully. Apr 29 09:10:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c3dd86ed-46ef-4146-9b35-5bd485ef2ef5 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-6427dffe-8565-49bf-ac67-d29b84818d2d-delete_snapshot" released by "delete_snapshot" :: held 3.595s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:18 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299" returned: 0 in 0.590s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828a1dcb-d867-43bf-9bd7-a6d881587c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce3bacda-6d24-491b-9a05-821e4d916299', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ddefbb-d582-4411-8330-43389263df2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:18 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Volume volume-ce3bacda-6d24-491b-9a05-821e4d916299 (ce3bacda-6d24-491b-9a05-821e4d916299): created successfully Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ddefbb-d582-4411-8330-43389263df2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Flow 'volume_create_manager' (fb94edbe-6399-45dc-98a6-873b2faffd5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a438db11-ba51-427d-aaca-f0e733e3b37d tempest-VolumesListTestJSON-318241000 None] Created volume successfully. Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Creating offline snapshot c7f2a1ca-f53d-4651-b855-5e2882ba41dd of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce2fc0-9c2a-48bc-a2a6-97ec921fd30d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:19 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:19 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Flow 'volume_create_manager' (54cfa622-480f-4b69-821c-fad52441359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d17b25-a688-4dce-bd35-2b47f95727b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d17b25-a688-4dce-bd35-2b47f95727b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554929910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d113f1d7-6b9f-4c34-8810-51032d85aa32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d294b3572a1407090a789602b9c2c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:20Z,use_quota=True,user_id='fb935237f71c4189b8870361b2b8f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c19226-65a7-49ef-8221-4052652ff7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c19226-65a7-49ef-8221-4052652ff7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d8d7f7-d033-4029-aea3-68a9f52124a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d8d7f7-d033-4029-aea3-68a9f52124a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd113f1d7-6b9f-4c34-8810-51032d85aa32', 'volume_name': 'volume-d113f1d7-6b9f-4c34-8810-51032d85aa32', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b192ba79-dba5-47a8-8002-354b8134f351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b192ba79-dba5-47a8-8002-354b8134f351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7333aff-a1dd-4004-a030-b6af6c44e779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:19 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Volume d113f1d7-6b9f-4c34-8810-51032d85aa32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d113f1d7-6b9f-4c34-8810-51032d85aa32', 'volume_size': 1} Apr 29 09:10:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:20 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 1.203s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:20 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd 1G Apr 29 09:10:20 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:21 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd 1G" returned: 0 in 1.564s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:21 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd Apr 29 09:10:21 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:22 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd" returned: 0 in 0.821s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:22 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd is being set with open permissions: ugo+rw Apr 29 09:10:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:22 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd Apr 29 09:10:22 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (bd9e7b8f-25bd-4e7c-b037-bf721067b5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7618606-d715-4c21-9b9d-f9c8a10e2915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7618606-d715-4c21-9b9d-f9c8a10e2915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-652264786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6396c8c3-c808-4319-a9ed-4c439dae44f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:23Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f576989-ac0f-4b0b-8f64-faba08f0de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f576989-ac0f-4b0b-8f64-faba08f0de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb05fc-1bec-46c9-a392-3b3256e9219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb05fc-1bec-46c9-a392-3b3256e9219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6396c8c3-c808-4319-a9ed-4c439dae44f9', 'volume_name': 'volume-6396c8c3-c808-4319-a9ed-4c439dae44f9', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad60b2ad-1e89-4564-a578-037117fd0f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad60b2ad-1e89-4564-a578-037117fd0f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b767f3d-b3a0-4ae3-be92-f1feb789b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:23 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Volume 6396c8c3-c808-4319-a9ed-4c439dae44f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6396c8c3-c808-4319-a9ed-4c439dae44f9', 'volume_size': 1} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:23 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd" returned: 0 in 0.931s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.736s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.764s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554929910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d113f1d7-6b9f-4c34-8810-51032d85aa32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d294b3572a1407090a789602b9c2c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:20Z,use_quota=True,user_id='fb935237f71c4189b8870361b2b8f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Creating volume d113f1d7-6b9f-4c34-8810-51032d85aa32 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:23 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:10:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:23 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-47de0808-034b-4138-a8ea-ae2ce365193a tempest-SnapshotsActionsTest-1292474880 None] Create snapshot completed successfully Apr 29 09:10:23 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 1073741824 Apr 29 09:10:23 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-c7f2a1ca-f53d-4651-b855-5e2882ba41dd-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-c7f2a1ca-f53d-4651-b855-5e2882ba41dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-c7f2a1ca-f53d-4651-b855-5e2882ba41dd" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-c7f2a1ca-f53d-4651-b855-5e2882ba41dd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Deleting offline snapshot c7f2a1ca-f53d-4651-b855-5e2882ba41dd of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] snapshot_file for this snap is: volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b8014b-7527-4e1e-93ff-dd86144b82f7]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:24 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd Apr 29 09:10:24 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:24 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 1073741824" returned: 0 in 1.042s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:24 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 Apr 29 09:10:24 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:25 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32" returned: 0 in 0.868s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.111s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-652264786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6396c8c3-c808-4319-a9ed-4c439dae44f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:23Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Creating volume 6396c8c3-c808-4319-a9ed-4c439dae44f9 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:10:25 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:25 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 1073741824 Apr 29 09:10:25 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:25 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7333aff-a1dd-4004-a030-b6af6c44e779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d113f1d7-6b9f-4c34-8810-51032d85aa32', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95145ec-702c-4330-8a67-4e3e1c5417cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd" returned: 0 in 1.252s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:25 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Volume volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 (d113f1d7-6b9f-4c34-8810-51032d85aa32): created successfully Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95145ec-702c-4330-8a67-4e3e1c5417cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Flow 'volume_create_manager' (54cfa622-480f-4b69-821c-fad52441359d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b2814-48de-47a3-9e1e-aba7b7c931db]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:25 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4c3ab0d8-1dbb-4b33-8409-1313a963eb0a tempest-VolumesListTestJSON-318241000 None] Created volume successfully. Apr 29 09:10:26 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:26 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:26 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 1073741824" returned: 0 in 1.048s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:26 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.992s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:26 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd Apr 29 09:10:26 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:26 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 Apr 29 09:10:26 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:28 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9" returned: 0 in 1.817s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] <== create_volume: return (2944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:10:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.953s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b767f3d-b3a0-4ae3-be92-f1feb789b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6396c8c3-c808-4319-a9ed-4c439dae44f9', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be790a89-6d41-4851-bd2d-915c85f43881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:28 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Volume volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 (6396c8c3-c808-4319-a9ed-4c439dae44f9): created successfully Apr 29 09:10:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be790a89-6d41-4851-bd2d-915c85f43881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (bd9e7b8f-25bd-4e7c-b037-bf721067b5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:28 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5f5d423c-d43d-410a-906c-94dc3d9d9ed9 tempest-VolumesActionsTest-960258109 None] Created volume successfully. Apr 29 09:10:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09029bec-0cff-4ffd-b891-bf013c40a808 tempest-VolumesActionsTest-960258109 None] Acquiring lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9" by "attach_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09029bec-0cff-4ffd-b891-bf013c40a808 tempest-VolumesActionsTest-960258109 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9" acquired by "attach_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-09029bec-0cff-4ffd-b891-bf013c40a808 tempest-VolumesActionsTest-960258109 None] Attaching volume 6396c8c3-c808-4319-a9ed-4c439dae44f9 to instance a8421034-9918-482f-9204-fbd6eba5dcf4 at mountpoint /dev/vdb on host None. Apr 29 09:10:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-09029bec-0cff-4ffd-b891-bf013c40a808 tempest-VolumesActionsTest-960258109 None] Attach volume completed successfully. Apr 29 09:10:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-09029bec-0cff-4ffd-b891-bf013c40a808 tempest-VolumesActionsTest-960258109 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9" released by "attach_volume" :: held 0.195s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:29 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd" returned: 0 in 2.403s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:29 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd Apr 29 09:10:29 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:30 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.c7f2a1ca-f53d-4651-b855-5e2882ba41dd" returned: 0 in 1.434s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-c7f2a1ca-f53d-4651-b855-5e2882ba41dd" released by "_delete_snapshot" :: held 6.245s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:30 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4ed41304-ad8a-407a-a662-752d4f2ccce9 tempest-VolumesActionsTest-246996943 None] Terminate volume connection completed successfully. Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" released by "delete_snapshot" :: held 6.287s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Acquiring lock "cinder-d113f1d7-6b9f-4c34-8810-51032d85aa32-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Lock "cinder-d113f1d7-6b9f-4c34-8810-51032d85aa32-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Acquiring lock "cinder-quobyte-d113f1d7-6b9f-4c34-8810-51032d85aa32" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Created reservations ['607ab60f-68e4-41c8-aa47-d5c33f7ab309', 'bbcdbfab-6310-472b-ac8c-c2f35e3d9db2', 'd091e0e7-6a12-42d2-b45c-c865cdd65014', 'f6528ff3-1305-4d61-92ce-6ff48ed72c66'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Lock "cinder-quobyte-d113f1d7-6b9f-4c34-8810-51032d85aa32" acquired by "delete_volume" :: waited 0.038s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379472c-7338-402a-9f65-467d17667534]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Delete snapshot completed successfully. Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a5f3b4fa-8edb-4474-8aa2-24622e03e3e2 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-c7f2a1ca-f53d-4651-b855-5e2882ba41dd-delete_snapshot" released by "delete_snapshot" :: held 6.573s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:31 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 Apr 29 09:10:31 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4ed41304-ad8a-407a-a662-752d4f2ccce9 tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-detach_volume" by "detach_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4ed41304-ad8a-407a-a662-752d4f2ccce9 tempest-VolumesActionsTest-246996943 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4ed41304-ad8a-407a-a662-752d4f2ccce9 tempest-VolumesActionsTest-246996943 None] Detaching volume 6396c8c3-c808-4319-a9ed-4c439dae44f9 from instance a8421034-9918-482f-9204-fbd6eba5dcf4. Apr 29 09:10:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4ed41304-ad8a-407a-a662-752d4f2ccce9 tempest-VolumesActionsTest-246996943 None] Detach volume completed successfully. Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4ed41304-ad8a-407a-a662-752d4f2ccce9 tempest-VolumesActionsTest-246996943 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f06547c7-4eda-44e5-88f7-2f6961ecff81 tempest-VolumesActionsTest-337901378 None] Acquiring lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" by "attach_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f06547c7-4eda-44e5-88f7-2f6961ecff81 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" acquired by "attach_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f06547c7-4eda-44e5-88f7-2f6961ecff81 tempest-VolumesActionsTest-337901378 None] Attaching volume ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 to instance 3fa800f5-af99-4080-bfb4-47049bbbb782 at mountpoint /dev/vdb on host None. Apr 29 09:10:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f06547c7-4eda-44e5-88f7-2f6961ecff81 tempest-VolumesActionsTest-337901378 None] Attach volume completed successfully. Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f06547c7-4eda-44e5-88f7-2f6961ecff81 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" released by "attach_volume" :: held 0.136s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:31 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32" returned: 0 in 0.955s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:31 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32 Apr 29 09:10:31 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b7ccb299-7fd1-44fe-8cae-ab941fd2bafb tempest-VolumesActionsTest-960258109 None] Acquiring lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-detach_volume" by "detach_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b7ccb299-7fd1-44fe-8cae-ab941fd2bafb tempest-VolumesActionsTest-960258109 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b7ccb299-7fd1-44fe-8cae-ab941fd2bafb tempest-VolumesActionsTest-960258109 None] Volume detach called, but volume not attached. Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b7ccb299-7fd1-44fe-8cae-ab941fd2bafb tempest-VolumesActionsTest-960258109 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdecca03-0489-457b-aa5e-676785afcdf8 tempest-VolumesActionsTest-337901378 None] Acquiring lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-detach_volume" by "detach_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdecca03-0489-457b-aa5e-676785afcdf8 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fdecca03-0489-457b-aa5e-676785afcdf8 tempest-VolumesActionsTest-337901378 None] Detaching volume ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 from instance 3fa800f5-af99-4080-bfb4-47049bbbb782. Apr 29 09:10:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fdecca03-0489-457b-aa5e-676785afcdf8 tempest-VolumesActionsTest-337901378 None] Detach volume completed successfully. Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fdecca03-0489-457b-aa5e-676785afcdf8 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:32 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-d113f1d7-6b9f-4c34-8810-51032d85aa32" returned: 0 in 0.779s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Lock "cinder-quobyte-d113f1d7-6b9f-4c34-8810-51032d85aa32" released by "delete_volume" :: held 1.784s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Created reservations ['ca9cd3d3-d7c1-46c5-853a-04dce87aae80', 'd16f7149-ba4e-42ae-9295-a86e5a7ee53d', '8448a6ea-28d0-4fe1-8fa4-f99507a6132c', '25f8c59a-1df2-4788-aff9-035f9e26e874'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:32 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:10:32 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Creating offline snapshot d385405f-ed52-4c26-87ce-7fe3e230f780 of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Acquiring lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[783ec0b8-b1ab-4420-824b-76ff0688151f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Acquiring lock "cinder-quobyte-6396c8c3-c808-4319-a9ed-4c439dae44f9" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Lock "cinder-quobyte-6396c8c3-c808-4319-a9ed-4c439dae44f9" acquired by "delete_volume" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[729a8d69-5666-4ffd-9bf4-ed32a5794efd]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "cinder-ce3bacda-6d24-491b-9a05-821e4d916299-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-ce3bacda-6d24-491b-9a05-821e4d916299-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:33 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:33 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "cinder-quobyte-ce3bacda-6d24-491b-9a05-821e4d916299" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-quobyte-ce3bacda-6d24-491b-9a05-821e4d916299" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:33 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 Apr 29 09:10:33 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecf7351-13de-4c66-9a94-e150709fc9c4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:33 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.934s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Deleted volume successfully. Apr 29 09:10:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3be1b7ae-0967-4224-aa31-8c761e224fbb tempest-VolumesListTestJSON-318241000 None] Lock "cinder-d113f1d7-6b9f-4c34-8810-51032d85aa32-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:33 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 Apr 29 09:10:33 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:34 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 1.309s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:34 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 1G Apr 29 09:10:34 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:34 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9" returned: 0 in 1.109s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:34 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9 Apr 29 09:10:34 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:34 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299" returned: 0 in 1.141s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:34 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299 Apr 29 09:10:34 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:35 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6396c8c3-c808-4319-a9ed-4c439dae44f9" returned: 0 in 0.890s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Lock "cinder-quobyte-6396c8c3-c808-4319-a9ed-4c439dae44f9" released by "delete_volume" :: held 2.108s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Created reservations ['48b4b4a5-b2dd-4cdb-a265-f7dd1c4c602b', '68e51171-befe-4166-95b6-d68404fa8217', '3e29300d-0632-4203-87e9-49c6b14ca25d', '4764425e-acb9-4e78-a09f-42b07adb118c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:35 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 1G" returned: 0 in 1.171s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:35 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 Apr 29 09:10:35 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:35 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:10:35 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:35 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ce3bacda-6d24-491b-9a05-821e4d916299" returned: 0 in 0.844s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-quobyte-ce3bacda-6d24-491b-9a05-821e4d916299" released by "delete_volume" :: held 2.044s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Created reservations ['df1a3ed5-8d2e-45ad-b5fd-3fb9a8272bac', 'e1199107-abc0-4957-80e5-b76afe0fe519', '1bed4eb8-7305-43c8-bccd-11294a1e62e3', '94ecfec8-5abb-4296-8f06-9964ee7ad503'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:35 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:10:35 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:36 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.677s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Deleted volume successfully. Apr 29 09:10:36 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780" returned: 0 in 0.764s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:36 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 is being set with open permissions: ugo+rw Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:36 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-94811445-92fa-4684-9c8f-2daa13f603fe tempest-VolumesActionsTest-960258109 None] Lock "cinder-6396c8c3-c808-4319-a9ed-4c439dae44f9-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:36 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:36 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.732s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Deleted volume successfully. Apr 29 09:10:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-517bbff9-f286-43b1-98e9-1c5efe03ecd9 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-ce3bacda-6d24-491b-9a05-821e4d916299-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "cinder-b70c24f0-538c-43a4-aac0-333925901f4a-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-b70c24f0-538c-43a4-aac0-333925901f4a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "cinder-quobyte-b70c24f0-538c-43a4-aac0-333925901f4a" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:37 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780" returned: 0 in 0.773s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-quobyte-b70c24f0-538c-43a4-aac0-333925901f4a" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[2357560f-08b7-4708-85f5-16b4aaa90bfa]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f76e0557-275b-40b6-b4a4-2d853486db90 tempest-SnapshotsActionsTest-1292474880 None] Create snapshot completed successfully Apr 29 09:10:37 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a Apr 29 09:10:37 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:38 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a" returned: 0 in 0.868s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:38 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a Apr 29 09:10:38 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-d385405f-ed52-4c26-87ce-7fe3e230f780-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-d385405f-ed52-4c26-87ce-7fe3e230f780-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-d385405f-ed52-4c26-87ce-7fe3e230f780" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-d385405f-ed52-4c26-87ce-7fe3e230f780" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Deleting offline snapshot d385405f-ed52-4c26-87ce-7fe3e230f780 of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] snapshot_file for this snap is: volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[89896559-4292-4181-b3c5-39844f827df4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:38 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 Apr 29 09:10:38 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:38 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b70c24f0-538c-43a4-aac0-333925901f4a" returned: 0 in 0.836s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-quobyte-b70c24f0-538c-43a4-aac0-333925901f4a" released by "delete_volume" :: held 1.791s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Created reservations ['2eab6026-cdb9-47e2-8624-cb1d8262e24b', '72e69ab4-53ab-4a09-b0a3-d8e3484f4993', 'dc434ff4-fa3d-4a0d-8c6e-d0f85e2dddd0', '308d99be-630c-42f2-9282-5d5f6060024a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:39 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:10:39 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:39 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780" returned: 0 in 0.818s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40f33be-e549-48b9-9831-df09d6d3b678]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:39 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:10:39 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:40 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.876s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:40 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:10:40 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Deleted volume successfully. Apr 29 09:10:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3b338e55-53ce-4c1d-b7ff-84d43d0647c1 tempest-VolumesListTestJSON-318241000 None] Lock "cinder-b70c24f0-538c-43a4-aac0-333925901f4a-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:40 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 1.054s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:10:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:40 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 Apr 29 09:10:40 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:41 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780" returned: 0 in 0.871s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:41 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780 Apr 29 09:10:41 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:42 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.d385405f-ed52-4c26-87ce-7fe3e230f780" returned: 0 in 0.626s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-d385405f-ed52-4c26-87ce-7fe3e230f780" released by "_delete_snapshot" :: held 3.522s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" released by "delete_snapshot" :: held 3.550s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9da4478-3698-4de8-bb80-4fc73b57e0de]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Created reservations ['8d59d6b3-376b-40de-8373-55348acc435a', '37f35376-d418-4598-be42-f8a52b6e04c4', '72692de3-e55f-4d0e-a3b6-251876c45799', '2858d7fb-ef1e-4916-a50a-93140585f972'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:10:42 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Delete snapshot completed successfully. Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b82eae95-0b1d-40f5-b6be-ba0b2f540cf4 tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-d385405f-ed52-4c26-87ce-7fe3e230f780-delete_snapshot" released by "delete_snapshot" :: held 3.761s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:10:42 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:10:42 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:42 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.787s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae3127-5270-4641-b8ab-2c1b31650372]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Flow 'volume_create_manager' (e706255c-da94-47d4-a5b7-ec20469c458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72607b6-4514-48b8-970f-f2f4c319965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72607b6-4514-48b8-970f-f2f4c319965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1381751884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7ca858-7200-4fa2-a0b8-9e2092aa6a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1942c2479d485981a7ed6e84d5449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:43Z,use_quota=True,user_id='1ba007c242df4d03bd49d5e845400945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:43 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eebee2-125a-4bc7-8dd9-26a15db176ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eebee2-125a-4bc7-8dd9-26a15db176ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5542b511-a1ab-4226-8c8c-8cde790a27ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5542b511-a1ab-4226-8c8c-8cde790a27ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7ca858-7200-4fa2-a0b8-9e2092aa6a71', 'volume_name': 'volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71', 'volume_size': 2}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b57ed18-7f41-4ae1-8cda-909df44d0bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b57ed18-7f41-4ae1-8cda-909df44d0bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a53f345-90ad-4d85-8722-e4c66fd8938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Volume 2a7ca858-7200-4fa2-a0b8-9e2092aa6a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71', 'volume_size': 2} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:43 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.776s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.11899ad8-1af1-41ef-bb6b-f969ae9dc180c_ptahap.img {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:43 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.11899ad8-1af1-41ef-bb6b-f969ae9dc180c_ptahap.img Apr 29 09:10:43 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (78540688-8b22-43ab-951b-f7de5d64b8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9844d142-4616-4cc5-81c4-658dd7854190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9844d142-4616-4cc5-81c4-658dd7854190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021657458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a44427-e7aa-41f6-bcb4-5ac793e90e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:44Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f03a80-4b43-437c-b3be-67de8d4e1d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f03a80-4b43-437c-b3be-67de8d4e1d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0779ef49-b90f-4097-a590-74057659d312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:43 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0779ef49-b90f-4097-a590-74057659d312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a44427-e7aa-41f6-bcb4-5ac793e90e4c', 'volume_name': 'volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44c48fd-24ae-4f57-95a4-5f1e3d1bb64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44c48fd-24ae-4f57-95a4-5f1e3d1bb64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:10:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd604c-6eb1-47d4-891b-cc292d7e84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:10:44 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Volume 05a44427-e7aa-41f6-bcb4-5ac793e90e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c', 'volume_size': 1} Apr 29 09:10:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:10:48 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.11899ad8-1af1-41ef-bb6b-f969ae9dc180c_ptahap.img" returned: 0 in 4.365s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f6193-ae95-457a-9366-82b3487ac20f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:10:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:10:48 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:10:48 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:10:49 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 29 09:10:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.857s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:10:49 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54, size 1024.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.11899ad8-1af1-41ef-bb6b-f969ae9dc180c_ptahap.img {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:10:49 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Converted 1024.00 MB image at 234.55 MB/s Apr 29 09:10:49 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] 11899ad8-1af1-41ef-bb6b-f969ae9dc180 was raw, no need to convert to raw {{(pid=84004) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 09:10:59 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=97,cinder:UPDATE=87,cinder:DELETE=8,cinder:INSERT=26 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:10:59 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:DELETE=8,cinder:UPDATE=99,cinder:SELECT=84,cinder:INSERT=22 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:11:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:11:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:02 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:02 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:03 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.590s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.628s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Uploaded volume to glance image-id: 11899ad8-1af1-41ef-bb6b-f969ae9dc180. {{(pid=84004) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.602s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1381751884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7ca858-7200-4fa2-a0b8-9e2092aa6a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1942c2479d485981a7ed6e84d5449d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:43Z,use_quota=True,user_id='1ba007c242df4d03bd49d5e845400945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Creating volume 2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:07 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 2147483648 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:07 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 2147483648 Apr 29 09:11:07 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:07 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2570b63e-4861-4852-8c80-d7bcae0fb002 tempest-VolumesActionsTest-337901378 None] Copy volume to image completed successfully. Apr 29 09:11:08 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 2147483648" returned: 0 in 0.916s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:08 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 Apr 29 09:11:08 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:09 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" returned: 0 in 0.606s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 26.146s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a53f345-90ad-4d85-8722-e4c66fd8938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71', 'volume_size': 2}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a37b5a2-dcf1-4ca5-92e6-724235b18541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Creating offline snapshot f10cab8f-3944-4cf1-be82-19b5de89f1fe of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:11:09 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Volume volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 (2a7ca858-7200-4fa2-a0b8-9e2092aa6a71): created successfully Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a37b5a2-dcf1-4ca5-92e6-724235b18541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Flow 'volume_create_manager' (e706255c-da94-47d4-a5b7-ec20469c458a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc100ddc-d9fe-42a3-8f1a-b05e5e0395bc]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:09 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-eda155db-b083-46bf-b532-5a9eaf04364e tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Created volume successfully. Apr 29 09:11:09 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:11:09 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:10 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.766s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:11:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:10 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe 1G Apr 29 09:11:10 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:10 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe 1G" returned: 0 in 0.771s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:11 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe Apr 29 09:11:11 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:11 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe" returned: 0 in 0.652s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:11 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe is being set with open permissions: ugo+rw Apr 29 09:11:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:11 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe Apr 29 09:11:11 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:12 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe" returned: 0 in 0.579s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.888s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.246s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021657458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a44427-e7aa-41f6-bcb4-5ac793e90e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:44Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Creating volume 05a44427-e7aa-41f6-bcb4-5ac793e90e4c {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:12 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:12 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c 1073741824 Apr 29 09:11:12 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:12 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2584e70b-ea0a-4cf3-a769-ff2ae256a79d tempest-SnapshotsActionsTest-1292474880 None] Create snapshot completed successfully Apr 29 09:11:13 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c 1073741824" returned: 0 in 0.794s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:13 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c Apr 29 09:11:13 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-f10cab8f-3944-4cf1-be82-19b5de89f1fe-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-f10cab8f-3944-4cf1-be82-19b5de89f1fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Acquiring lock "cinder-quobyte-f10cab8f-3944-4cf1-be82-19b5de89f1fe" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-f10cab8f-3944-4cf1-be82-19b5de89f1fe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Deleting offline snapshot f10cab8f-3944-4cf1-be82-19b5de89f1fe of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] snapshot_file for this snap is: volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ebc14b-72a8-481c-92d2-dc0a3e9fd651]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:13 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe Apr 29 09:11:13 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:13 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c" returned: 0 in 0.626s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.725s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dd604c-6eb1-47d4-891b-cc292d7e84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c408a1-a326-4b88-8493-2047a56c9a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c8927-f913-4d60-9410-9a17de065896]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:13 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Volume volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c (05a44427-e7aa-41f6-bcb4-5ac793e90e4c): created successfully Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c408a1-a326-4b88-8493-2047a56c9a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (78540688-8b22-43ab-951b-f7de5d64b8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e2726ee5-3d35-4072-85ab-fce5cd68d0a8 tempest-VolumesActionsTest-960258109 None] Created volume successfully. Apr 29 09:11:13 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:11:13 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-05a44427-e7aa-41f6-bcb4-5ac793e90e4c-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Lock "cinder-05a44427-e7aa-41f6-bcb4-5ac793e90e4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-quobyte-05a44427-e7aa-41f6-bcb4-5ac793e90e4c" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-05a44427-e7aa-41f6-bcb4-5ac793e90e4c" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b2f5e2-da79-4739-9bbc-8b80eba2ae3d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:14 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe" returned: 0 in 0.778s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee38748-d51a-49c5-82fd-0b4b6dcc0ad0]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:14 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c Apr 29 09:11:14 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:14 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:11:14 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:14 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.775s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aba6833-f127-485c-bff5-2f121f79db96]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:14 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:11:14 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:14 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c" returned: 0 in 0.747s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:15 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c Apr 29 09:11:15 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:15 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.773s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:15 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe Apr 29 09:11:15 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:15 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.773s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:15 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img Apr 29 09:11:15 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:15 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-05a44427-e7aa-41f6-bcb4-5ac793e90e4c" returned: 0 in 0.637s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-05a44427-e7aa-41f6-bcb4-5ac793e90e4c" released by "delete_volume" :: held 1.430s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Created reservations ['378cf4bf-daba-4a21-a64f-f3911511d905', 'd92f0ab4-8eaf-4cda-a8f1-a8938b5e0a77', '8619ba62-0df4-4bfd-86ae-031bb7600bbf', '115a6605-9182-4478-8db0-3a6200a60108'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:15 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:15 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:15 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe" returned: 0 in 0.823s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:15 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe Apr 29 09:11:15 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:17 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.543s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Deleted volume successfully. Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9d0a6dfb-a5a4-482f-9916-0e612ef87476 tempest-VolumesActionsTest-246996943 None] Lock "cinder-05a44427-e7aa-41f6-bcb4-5ac793e90e4c-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:17 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (2d520b32-a8d5-448d-8e69-354d25ea6ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45aa39dc-00fa-4525-b4c1-1dd1d8821991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.f10cab8f-3944-4cf1-be82-19b5de89f1fe" returned: 0 in 1.911s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45aa39dc-00fa-4525-b4c1-1dd1d8821991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-759760033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:18Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07bc22f-4aa7-4790-9bda-22f0199ad148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07bc22f-4aa7-4790-9bda-22f0199ad148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bf0ab3-e8f3-4b78-8451-e51a24bec811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bf0ab3-e8f3-4b78-8451-e51a24bec811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5', 'volume_name': 'volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5b5977-ad48-4754-ab26-6d3d22c83331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5b5977-ad48-4754-ab26-6d3d22c83331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b271b3c-bea9-416d-b4e5-89fc7e577d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:18 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Volume a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5', 'volume_size': 1} Apr 29 09:11:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-f10cab8f-3944-4cf1-be82-19b5de89f1fe" released by "_delete_snapshot" :: held 4.561s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" released by "delete_snapshot" :: held 4.593s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:18 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Created reservations ['374d042d-2771-450d-9620-f991c89b968a', '68ab7443-ad90-4b5d-9b18-171745c02a80', 'b0ffbb16-bc89-4a4f-802b-32f505d81d27', '3c92d79b-623b-4743-ad5c-f63a782ccfe2'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Delete snapshot completed successfully. Apr 29 09:11:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-48eda2d4-0689-4c2e-b97c-3fc63eefcb9c tempest-SnapshotsActionsTest-1931925021 None] Lock "cinder-f10cab8f-3944-4cf1-be82-19b5de89f1fe-delete_snapshot" released by "delete_snapshot" :: held 4.867s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "cinder-7449de81-320e-47bf-aa6f-9e5c58996300-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-7449de81-320e-47bf-aa6f-9e5c58996300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "cinder-quobyte-7449de81-320e-47bf-aa6f-9e5c58996300" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-quobyte-7449de81-320e-47bf-aa6f-9e5c58996300" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Deleting offline snapshot 7449de81-320e-47bf-aa6f-9e5c58996300 of volume 44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] snapshot_file for this snap is: volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb82c99-e885-420e-9342-45197379245d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:20 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img" returned: 0 in 4.882s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f879bc83-7457-47b6-9817-c13aadf83d90]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:20 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:11:20 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:20 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:11:20 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:20 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.675s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d19655-5a62-4277-aeea-2710a216ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74c6ea1-ff39-40e9-9bc7-b5f2b103ad70]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:20 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 Apr 29 09:11:20 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:21 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.894s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:11:21 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Converted 1024.00 MB image at 209.67 MB/s Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] ab31382f-149a-4f7f-b5bd-631c10ebde47 was raw, converting to qcow2 {{(pid=84004) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[8147fbad-5967-46e5-b542-6fe93c4acae0]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:21 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img Apr 29 09:11:21 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:21 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74" returned: 0 in 0.729s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:21 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:11:21 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:21 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:21 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img Apr 29 09:11:21 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:22 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.747s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:22 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300 Apr 29 09:11:22 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:22 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img" returned: 1 in 0.679s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:11:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img /opt/stack/data/cinder/conversion/vol_upload_cprro87z {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:22 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img /opt/stack/data/cinder/conversion/vol_upload_cprro87z Apr 29 09:11:22 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:22 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74.7449de81-320e-47bf-aa6f-9e5c58996300" returned: 0 in 0.638s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-quobyte-7449de81-320e-47bf-aa6f-9e5c58996300" released by "_delete_snapshot" :: held 2.910s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" released by "delete_snapshot" :: held 2.934s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Created reservations ['c1762327-7eeb-46ed-a6e9-9766ba1ebe19', '99b91adc-844c-4b2b-ab7a-129aab2d119d', '8bb996ad-f2ad-4dfe-8688-e23f86f36b40', 'd6602a36-570f-4ef7-9308-bb36b4fd5262'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:23 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Delete snapshot completed successfully. Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-155587de-243e-42da-8fa5-ad1c80cae156 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-7449de81-320e-47bf-aa6f-9e5c58996300-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:23 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img /opt/stack/data/cinder/conversion/vol_upload_cprro87z" returned: 0 in 0.926s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Image conversion details: src /opt/stack/data/cinder/conversion/ec3e0eb4-63ae-463c-bab7-cc3c1b574a54.temp_image.ab31382f-149a-4f7f-b5bd-631c10ebde475j82g64e.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cprro87z {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:11:23 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[24237e7e-2487-40d6-b76e-addb2695c8a0]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cprro87z {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:23 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cprro87z Apr 29 09:11:23 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:24 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cprro87z" returned: 0 in 0.663s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "cinder-44d19655-5a62-4277-aeea-2710a216ff74-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-44d19655-5a62-4277-aeea-2710a216ff74-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:24 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b253eb-ed7e-4320-98ef-290f99603a40]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:24 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 Apr 29 09:11:24 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:25 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74" returned: 0 in 0.716s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:25 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74 Apr 29 09:11:25 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.619s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Uploaded volume to glance image-id: ab31382f-149a-4f7f-b5bd-631c10ebde47. {{(pid=84004) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.142s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Creating offline snapshot 0fd10d8a-b022-4be1-ab74-5588c5265d63 of volume 2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:11:25 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-ef5f376a-df3b-4073-8362-1538963b84d9 tempest-VolumesActionsTest-337901378 None] Copy volume to image completed successfully. Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[214794ff-55b0-43f3-a678-f2806d05837f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:25 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 Apr 29 09:11:25 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:25 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-44d19655-5a62-4277-aeea-2710a216ff74" returned: 0 in 0.570s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-quobyte-44d19655-5a62-4277-aeea-2710a216ff74" released by "delete_volume" :: held 1.358s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Created reservations ['28ceadec-3e34-466c-9844-a734c08d7ba9', '51e72814-708e-4d67-a4fb-84aba0e98213', '60e45621-52e8-4115-afb8-625bdbb44d75', '562f5d8f-d6b5-44ec-b692-cc218c7b8427'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:25 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:25 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:26 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" returned: 0 in 0.730s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 2G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:26 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 2G Apr 29 09:11:26 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Acquiring lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Acquiring lock "cinder-quobyte-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Lock "cinder-quobyte-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0621dc-1c7d-4a08-9418-bf81894799d4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:26 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.681s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Deleted volume successfully. Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a90f8eb9-aba7-4b8d-b88c-0e1c00d44151 tempest-SnapshotsActionsTest-1292474880 None] Lock "cinder-44d19655-5a62-4277-aeea-2710a216ff74-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:26 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:11:26 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:26 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 2G" returned: 0 in 0.815s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:26 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 Apr 29 09:11:26 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:27 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.798s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:27 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54 Apr 29 09:11:27 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:27 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63" returned: 0 in 0.681s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:27 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 is being set with open permissions: ugo+rw Apr 29 09:11:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:27 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 Apr 29 09:11:27 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:28 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" returned: 0 in 0.645s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Lock "cinder-quobyte-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54" released by "delete_volume" :: held 1.498s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Created reservations ['0fc4dde5-2df8-4290-91fe-db85afa92777', '9b3a5425-1408-48e9-9401-2d1fab72dce3', 'c94456ce-988d-4156-8953-858c963d2a9c', 'cad43ea8-8af4-4bde-9103-948d2025218c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:28 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:28 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:28 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63" returned: 0 in 0.687s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:28 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.info Apr 29 09:11:28 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:28 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.691s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:28 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Deleted volume successfully. Apr 29 09:11:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-822a30b3-3745-4451-b3f3-16e303c09861 tempest-VolumesActionsTest-337901378 None] Lock "cinder-ec3e0eb4-63ae-463c-bab7-cc3c1b574a54-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:29 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.info" returned: 0 in 0.740s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:29 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.info is being set with open permissions: ugo+rw Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:29 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.info Apr 29 09:11:29 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:29 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.info" returned: 0 in 0.643s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.406s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.742s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-759760033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:18Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Creating volume a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:29 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:29 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 1073741824 Apr 29 09:11:29 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-19450e16-b109-4c0c-98c4-251888a1a4d4 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Create snapshot completed successfully Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "cinder-0fd10d8a-b022-4be1-ab74-5588c5265d63-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-0fd10d8a-b022-4be1-ab74-5588c5265d63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "cinder-quobyte-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-quobyte-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "cinder-quobyte-0fd10d8a-b022-4be1-ab74-5588c5265d63" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-quobyte-0fd10d8a-b022-4be1-ab74-5588c5265d63" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Deleting offline snapshot 0fd10d8a-b022-4be1-ab74-5588c5265d63 of volume 2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] snapshot_file for this snap is: volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c5c7e-9f00-4c1c-8e91-05a55c3d03ec]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:30 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 Apr 29 09:11:30 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:30 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 1073741824" returned: 0 in 0.939s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:30 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 Apr 29 09:11:30 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:31 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63" returned: 0 in 0.784s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[63931d2e-a64f-4b1e-b949-2d8f9a8fe671]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:31 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 Apr 29 09:11:31 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:31 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5" returned: 0 in 0.766s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b271b3c-bea9-416d-b4e5-89fc7e577d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18465596-111e-43f3-a9f0-b3b4d738e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:31 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Volume volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 (a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5): created successfully Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18465596-111e-43f3-a9f0-b3b4d738e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (2d520b32-a8d5-448d-8e69-354d25ea6ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-67ad00d5-48f8-4bd6-96cd-8d371dce4da3 tempest-VolumesActionsTest-960258109 None] Created volume successfully. Apr 29 09:11:32 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" returned: 0 in 0.870s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:32 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 Apr 29 09:11:32 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Lock "cinder-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-quobyte-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[20799229-e9d4-48ff-ad2a-f8f99eb9eaed]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:33 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63" returned: 0 in 1.031s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:33 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63 Apr 29 09:11:33 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:33 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 Apr 29 09:11:33 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:33 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71.0fd10d8a-b022-4be1-ab74-5588c5265d63" returned: 0 in 0.682s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-quobyte-0fd10d8a-b022-4be1-ab74-5588c5265d63" released by "_delete_snapshot" :: held 3.516s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-quobyte-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" released by "delete_snapshot" :: held 3.547s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:34 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5" returned: 0 in 0.842s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:34 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5 Apr 29 09:11:34 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Created reservations ['73cc6199-b28d-461a-9d69-5826ef4d053e', 'ec36053a-336d-4f7a-a9d2-07ec8c2350b4', 'be3fba4a-0eb8-492a-8fa2-f83de9e1e3fc', 'f5155b82-8b30-4a2b-9852-b1673796f3d4'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:34 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Delete snapshot completed successfully. Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-60165654-a957-48da-b721-affe75f8b320 tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-0fd10d8a-b022-4be1-ab74-5588c5265d63-delete_snapshot" released by "delete_snapshot" :: held 3.770s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:34 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5" returned: 0 in 0.703s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5" released by "delete_volume" :: held 1.603s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "cinder-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Created reservations ['6833faf4-ae21-413f-81df-6488f67f9418', '1340acf5-da21-4418-8368-8e8425be1cb4', 'fc4e29ab-f921-4a4d-88f4-78b5d33430e5', '37b6e619-53aa-40ed-b493-99ddddc40a9b'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "cinder-quobyte-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-quobyte-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a8c44-6d8d-40b9-bdf6-406dcedd5b45]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:35 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:35 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:35 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 Apr 29 09:11:35 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Flow 'volume_create_manager' (28f60590-ea36-40a5-96e5-871a3409c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9977d91-d31f-49c8-807d-5c62c9f81694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9977d91-d31f-49c8-807d-5c62c9f81694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1116763909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac968d40-2211-452f-b170-52edcb8f2547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c389368d894935bdfdb9091821ef24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:36Z,use_quota=True,user_id='2b8f36e8b5ad441997917bea7c311e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fc504e-8055-46da-b72e-1fc9aba54cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fc504e-8055-46da-b72e-1fc9aba54cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6aa28c-3173-49fb-9c7f-45fc94715318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6aa28c-3173-49fb-9c7f-45fc94715318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac968d40-2211-452f-b170-52edcb8f2547', 'volume_name': 'volume-ac968d40-2211-452f-b170-52edcb8f2547', 'volume_size': 2}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a7331b-cf93-4dd4-8b69-35a0f2f7d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a7331b-cf93-4dd4-8b69-35a0f2f7d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5558f0-20a0-435b-90a1-6e0ed53715f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:35 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Volume ac968d40-2211-452f-b170-52edcb8f2547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac968d40-2211-452f-b170-52edcb8f2547', 'volume_size': 2} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1116763909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac968d40-2211-452f-b170-52edcb8f2547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c389368d894935bdfdb9091821ef24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:36Z,use_quota=True,user_id='2b8f36e8b5ad441997917bea7c311e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Creating volume ac968d40-2211-452f-b170-52edcb8f2547 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:35 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 2147483648 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:35 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 2147483648 Apr 29 09:11:35 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:35 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" returned: 0 in 0.919s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:35 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71 Apr 29 09:11:35 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:36 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.016s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Deleted volume successfully. Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-529c9a6d-21fa-447e-bf42-d4602e84214d tempest-VolumesActionsTest-246996943 None] Lock "cinder-a9d18f7a-c8a0-4018-98c3-8b1eaf11bea5-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (13296462-c00f-4431-9112-ea37db76168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dad9b0-ab50-4f11-9c01-94716f8bf2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dad9b0-ab50-4f11-9c01-94716f8bf2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148777204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dde93e1-ee78-498e-a328-8599d2a8f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:36Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41dbe4e0-9824-4159-8212-7a40e168b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41dbe4e0-9824-4159-8212-7a40e168b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da1e7a4-a073-4ebd-9af7-ee7fde3b4971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da1e7a4-a073-4ebd-9af7-ee7fde3b4971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dde93e1-ee78-498e-a328-8599d2a8f785', 'volume_name': 'volume-4dde93e1-ee78-498e-a328-8599d2a8f785', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898a98e8-bd8d-470e-91d4-192917140889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898a98e8-bd8d-470e-91d4-192917140889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68116550-1431-4735-9de0-067548a7c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:36 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Volume 4dde93e1-ee78-498e-a328-8599d2a8f785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dde93e1-ee78-498e-a328-8599d2a8f785', 'volume_size': 1} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:36 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" returned: 0 in 0.784s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-quobyte-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71" released by "delete_volume" :: held 1.774s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Created reservations ['dcba8aa1-1443-43d3-bd5f-04c95e180be3', '2e27ba82-581d-4479-9729-346b1285e714', '52fcd701-dc23-4173-8f3b-09b440527e9c', '7e0cb496-8ee3-4570-a94c-dee7e3395fed'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:36 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:36 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:36 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 2147483648" returned: 0 in 1.105s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:36 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 Apr 29 09:11:36 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:37 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.648s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Deleted volume successfully. Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32fb175f-1549-4ee7-b99f-088d4d4f349c tempest-VolumesSnapshotNegativeTestJSON-1509514729 None] Lock "cinder-2a7ca858-7200-4fa2-a0b8-9e2092aa6a71-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:37 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547" returned: 0 in 0.688s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148777204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dde93e1-ee78-498e-a328-8599d2a8f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:36Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Creating volume 4dde93e1-ee78-498e-a328-8599d2a8f785 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:37 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:37 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 1073741824 Apr 29 09:11:37 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5558f0-20a0-435b-90a1-6e0ed53715f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac968d40-2211-452f-b170-52edcb8f2547', 'volume_size': 2}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24496551-d51e-4f6f-8c39-0ac65b3c86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:37 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Volume volume-ac968d40-2211-452f-b170-52edcb8f2547 (ac968d40-2211-452f-b170-52edcb8f2547): created successfully Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24496551-d51e-4f6f-8c39-0ac65b3c86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Flow 'volume_create_manager' (28f60590-ea36-40a5-96e5-871a3409c68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2e8152fc-c680-405c-b043-36613757f279 tempest-VolumesCloneNegativeTest-1956355338 None] Created volume successfully. Apr 29 09:11:38 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 1073741824" returned: 0 in 0.890s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:38 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 Apr 29 09:11:38 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Acquiring lock "cinder-ac968d40-2211-452f-b170-52edcb8f2547-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "cinder-ac968d40-2211-452f-b170-52edcb8f2547-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Acquiring lock "cinder-quobyte-ac968d40-2211-452f-b170-52edcb8f2547" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "cinder-quobyte-ac968d40-2211-452f-b170-52edcb8f2547" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea5b57b-afb8-4271-afc1-feaaeffeb5c2]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:39 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 Apr 29 09:11:39 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:39 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785" returned: 0 in 0.805s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68116550-1431-4735-9de0-067548a7c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dde93e1-ee78-498e-a328-8599d2a8f785', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec438e4-f0e4-4f23-beff-5659cba60c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:39 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Volume volume-4dde93e1-ee78-498e-a328-8599d2a8f785 (4dde93e1-ee78-498e-a328-8599d2a8f785): created successfully Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec438e4-f0e4-4f23-beff-5659cba60c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (13296462-c00f-4431-9112-ea37db76168a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:39 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e903f88f-d1de-442f-b8a5-b1188c56bb2b tempest-VolumesActionsTest-960258109 None] Created volume successfully. Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Flow 'volume_create_manager' (48441b4d-fef8-4bb9-92e3-6d32ef02a1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab68826-413f-4b8c-8538-8481bfd196ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab68826-413f-4b8c-8538-8481bfd196ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-398475958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad1fb85-244d-410f-9cd6-f7a065a85733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ee354e887b47678ed70dbbe5e7cd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:40Z,use_quota=True,user_id='8ee14d66f34b4ba9a83bd41cf8ff42c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7c6137-d979-499b-bf59-ee82845f0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7c6137-d979-499b-bf59-ee82845f0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e629a97-3aa5-4cd8-a62e-c889406ee385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e629a97-3aa5-4cd8-a62e-c889406ee385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad1fb85-244d-410f-9cd6-f7a065a85733', 'volume_name': 'volume-9ad1fb85-244d-410f-9cd6-f7a065a85733', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44503a2c-399e-4f73-94c4-2d82c6e8b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44503a2c-399e-4f73-94c4-2d82c6e8b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b181c4e8-c833-47af-821d-88668af2befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:39 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Volume 9ad1fb85-244d-410f-9cd6-f7a065a85733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad1fb85-244d-410f-9cd6-f7a065a85733', 'volume_size': 1} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-398475958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad1fb85-244d-410f-9cd6-f7a065a85733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ee354e887b47678ed70dbbe5e7cd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:40Z,use_quota=True,user_id='8ee14d66f34b4ba9a83bd41cf8ff42c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Creating volume 9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:39 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:39 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 1073741824 Apr 29 09:11:39 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:39 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547" returned: 0 in 0.799s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:39 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547 Apr 29 09:11:39 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:40 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ac968d40-2211-452f-b170-52edcb8f2547" returned: 0 in 0.643s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:40 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 1073741824" returned: 0 in 0.939s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "cinder-quobyte-ac968d40-2211-452f-b170-52edcb8f2547" released by "delete_volume" :: held 1.501s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Created reservations ['f88ff820-2832-408f-813e-d1eff7943c10', '422c5414-b7e8-45ed-a660-3dcb80d6364a', 'e3c97577-fd88-4a00-a6f8-33c9edd55842', '8810c33a-b3d9-4d5e-b47e-9fea40bc5985'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:40 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 Apr 29 09:11:40 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-4dde93e1-ee78-498e-a328-8599d2a8f785-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Lock "cinder-4dde93e1-ee78-498e-a328-8599d2a8f785-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-quobyte-4dde93e1-ee78-498e-a328-8599d2a8f785" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:40 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:40 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-4dde93e1-ee78-498e-a328-8599d2a8f785" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bcced7-be0e-4a8c-adf3-f8f23db67606]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:41 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 Apr 29 09:11:41 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:41 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733" returned: 0 in 0.886s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b181c4e8-c833-47af-821d-88668af2befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad1fb85-244d-410f-9cd6-f7a065a85733', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c0669-217b-496b-93f9-d8f26a18d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:41 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Volume volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 (9ad1fb85-244d-410f-9cd6-f7a065a85733): created successfully Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c0669-217b-496b-93f9-d8f26a18d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Flow 'volume_create_manager' (48441b4d-fef8-4bb9-92e3-6d32ef02a1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:41 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-36e5dfda-0c82-4173-804d-48be7ae4ee61 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Created volume successfully. Apr 29 09:11:41 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.960s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:41 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Deleted volume successfully. Apr 29 09:11:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-75c23365-6128-4cad-a796-5c2a201cb5c0 tempest-VolumesCloneNegativeTest-1956355338 None] Lock "cinder-ac968d40-2211-452f-b170-52edcb8f2547-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:42 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785" returned: 0 in 1.074s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:42 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785 Apr 29 09:11:42 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Creating offline snapshot e788f229-7f10-469f-bb6e-4138f72a94fe of volume 9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e09847-fc6e-4f71-a6eb-6262a196eba3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:42 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 Apr 29 09:11:42 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:42 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4dde93e1-ee78-498e-a328-8599d2a8f785" returned: 0 in 0.718s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-4dde93e1-ee78-498e-a328-8599d2a8f785" released by "delete_volume" :: held 1.846s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Created reservations ['0de5a962-4162-4af7-a402-3cb632ce765d', '212bebfa-521d-4a98-915e-905e74fcc781', '5a888d1f-54e0-4585-9b73-9cc34c894f29', '79615f19-c48e-40e4-9cf1-e40a780741cc'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:42 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733" returned: 0 in 0.775s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:43 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe 1G Apr 29 09:11:43 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:43 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:43 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:43 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:43 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe 1G" returned: 0 in 0.927s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.852s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:43 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Deleted volume successfully. Apr 29 09:11:43 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe Apr 29 09:11:43 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:43 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3b14cc2-0229-4555-99c0-699c6a1a1f13 tempest-VolumesActionsTest-246996943 None] Lock "cinder-4dde93e1-ee78-498e-a328-8599d2a8f785-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (c7c76840-c4df-46f9-ac2d-64b8e3ffd45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e658630c-ed64-4abe-828c-6e0a03a9f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e658630c-ed64-4abe-828c-6e0a03a9f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1016786881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96aec6a7-e1f0-422c-98c9-c7f851b4c661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:44Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2215e8-c1d7-4284-8c28-52d3fc540b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2215e8-c1d7-4284-8c28-52d3fc540b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375ddfe9-cda5-4eb0-8009-4f2474cb4f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375ddfe9-cda5-4eb0-8009-4f2474cb4f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96aec6a7-e1f0-422c-98c9-c7f851b4c661', 'volume_name': 'volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5bbea1-7d5a-46f4-ae99-a0224e2ddb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5bbea1-7d5a-46f4-ae99-a0224e2ddb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5efb61-11e8-48d9-89b3-64c0179e5367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:44 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Volume 96aec6a7-e1f0-422c-98c9-c7f851b4c661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661', 'volume_size': 1} Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:44 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe" returned: 0 in 0.739s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:44 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe is being set with open permissions: ugo+rw Apr 29 09:11:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:44 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe Apr 29 09:11:44 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:45 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe" returned: 0 in 0.664s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:45 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.info Apr 29 09:11:45 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:45 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.info" returned: 0 in 0.664s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:46 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.info is being set with open permissions: ugo+rw Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:46 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.info Apr 29 09:11:46 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:46 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.info" returned: 0 in 0.694s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.582s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.618s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1016786881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96aec6a7-e1f0-422c-98c9-c7f851b4c661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:44Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Creating volume 96aec6a7-e1f0-422c-98c9-c7f851b4c661 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:46 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:46 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 1073741824 Apr 29 09:11:46 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:46 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-64892866-7988-4b8b-be65-5aa0f5c0ceef tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Create snapshot completed successfully Apr 29 09:11:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "cinder-e788f229-7f10-469f-bb6e-4138f72a94fe-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:47 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 1073741824" returned: 0 in 1.229s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-e788f229-7f10-469f-bb6e-4138f72a94fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "cinder-quobyte-9ad1fb85-244d-410f-9cd6-f7a065a85733" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-quobyte-9ad1fb85-244d-410f-9cd6-f7a065a85733" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "cinder-quobyte-e788f229-7f10-469f-bb6e-4138f72a94fe" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-quobyte-e788f229-7f10-469f-bb6e-4138f72a94fe" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Deleting offline snapshot e788f229-7f10-469f-bb6e-4138f72a94fe of volume 9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] snapshot_file for this snap is: volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da6c80-6f32-4df1-9deb-5f58c290e362]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:48 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 Apr 29 09:11:48 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:48 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe Apr 29 09:11:48 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:48 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661" returned: 0 in 0.874s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.250s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5efb61-11e8-48d9-89b3-64c0179e5367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68582b95-ba83-4d41-a244-36c77d68532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:49 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Volume volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 (96aec6a7-e1f0-422c-98c9-c7f851b4c661): created successfully Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68582b95-ba83-4d41-a244-36c77d68532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (c7c76840-c4df-46f9-ac2d-64b8e3ffd45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:49 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-38830e4a-5eaa-435b-86b6-a5c0e56d2640 tempest-VolumesActionsTest-960258109 None] Created volume successfully. Apr 29 09:11:49 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe" returned: 0 in 1.053s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ad1fb85-244d-410f-9cd6-f7a065a85733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd092a04-29a9-465d-8fd1-a00f59cf252b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:49 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 Apr 29 09:11:49 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-96aec6a7-e1f0-422c-98c9-c7f851b4c661-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Lock "cinder-96aec6a7-e1f0-422c-98c9-c7f851b4c661-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Acquiring lock "cinder-quobyte-96aec6a7-e1f0-422c-98c9-c7f851b4c661" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-96aec6a7-e1f0-422c-98c9-c7f851b4c661" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c599195-8f05-47ae-b468-ba3c76a5dc93]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:49 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 Apr 29 09:11:49 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:50 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733" returned: 0 in 0.983s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:50 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe Apr 29 09:11:50 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:50 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661" returned: 0 in 0.810s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:50 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661 Apr 29 09:11:50 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:51 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe" returned: 0 in 0.887s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:51 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe Apr 29 09:11:51 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:51 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-96aec6a7-e1f0-422c-98c9-c7f851b4c661" returned: 0 in 0.734s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Lock "cinder-quobyte-96aec6a7-e1f0-422c-98c9-c7f851b4c661" released by "delete_volume" :: held 1.625s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Created reservations ['1ef9a63d-29b6-4a6b-817b-2923bfbdbeae', '024f6caa-3a54-451d-9184-7d3e0a58529f', '60b26ca9-504c-43c1-b1d9-3e264a01d382', '61917d28-9a2c-46be-8ff5-cf7619617ae3'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:51 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:51 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:51 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733.e788f229-7f10-469f-bb6e-4138f72a94fe" returned: 0 in 0.807s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-quobyte-e788f229-7f10-469f-bb6e-4138f72a94fe" released by "_delete_snapshot" :: held 3.927s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-quobyte-9ad1fb85-244d-410f-9cd6-f7a065a85733" released by "delete_snapshot" :: held 3.970s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Created reservations ['18cd4727-d0eb-4b95-b6bf-a2526d23c851', '24e7596a-695a-44e6-9c50-30b5d190501c', '5b19d28b-7b9e-4a82-a7a0-fa7e1727164c', '0cb01ed3-6f87-40c5-a712-8facc0570319'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:52 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Delete snapshot completed successfully. Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9ee4ea26-49a8-4db6-ae40-c67eb88a95e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-e788f229-7f10-469f-bb6e-4138f72a94fe-delete_snapshot" released by "delete_snapshot" :: held 4.242s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "cinder-9ad1fb85-244d-410f-9cd6-f7a065a85733-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:52 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-9ad1fb85-244d-410f-9cd6-f7a065a85733-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.907s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:52 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Deleted volume successfully. Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "cinder-quobyte-9ad1fb85-244d-410f-9cd6-f7a065a85733" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a7835ef2-2876-4228-964c-9fdfe46ad30c tempest-VolumesActionsTest-246996943 None] Lock "cinder-96aec6a7-e1f0-422c-98c9-c7f851b4c661-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-quobyte-9ad1fb85-244d-410f-9cd6-f7a065a85733" acquired by "delete_volume" :: waited 0.032s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da25d8f-c98f-4064-a374-8d01cebb85b6]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (b215b7b2-c975-4116-ae2c-c276729f6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9d36da-9ca7-4426-b5fe-f28f8df147c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9d36da-9ca7-4426-b5fe-f28f8df147c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314201357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d2f227-c3ff-4667-80fb-7adcb1fa05e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:53Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ea4d38-86f3-4ca2-a30c-0ebd53ae5621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ea4d38-86f3-4ca2-a30c-0ebd53ae5621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcb0e45-88eb-4591-ab1c-6a6b2d4340e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcb0e45-88eb-4591-ab1c-6a6b2d4340e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d2f227-c3ff-4667-80fb-7adcb1fa05e5', 'volume_name': 'volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b60388-d9e2-448c-8475-57ed2a521ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b60388-d9e2-448c-8475-57ed2a521ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94dbf0d-55ec-4d15-bfc0-8a9f5e8f53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:52 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Volume 24d2f227-c3ff-4667-80fb-7adcb1fa05e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5', 'volume_size': 1} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314201357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d2f227-c3ff-4667-80fb-7adcb1fa05e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcda2fec47343f8a275cb1c38af4d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:53Z,use_quota=True,user_id='88be562759fb42f0b7170b25dc137bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Creating volume 24d2f227-c3ff-4667-80fb-7adcb1fa05e5 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:11:52 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:11:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:52 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 Apr 29 09:11:52 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:52 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 1073741824 Apr 29 09:11:52 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:53 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733" returned: 0 in 0.880s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:53 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733 Apr 29 09:11:53 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:53 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 1073741824" returned: 0 in 1.200s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:54 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 Apr 29 09:11:54 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:54 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9ad1fb85-244d-410f-9cd6-f7a065a85733" returned: 0 in 1.021s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-quobyte-9ad1fb85-244d-410f-9cd6-f7a065a85733" released by "delete_volume" :: held 1.986s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Created reservations ['8d4c85cb-4442-4dd4-bde5-e65aca58aa44', '216b02d7-55d7-4175-94b8-095efb5d8520', '1a4885ef-24e0-4c9b-8b87-a165f595e0c4', 'ff38dae5-d5eb-4806-9a2a-921cdcd21f9d'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:54 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:54 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:54 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5" returned: 0 in 0.797s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94dbf0d-55ec-4d15-bfc0-8a9f5e8f53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c3b301-8c4e-47a5-b0f9-176c30cd9d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:11:54 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Volume volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 (24d2f227-c3ff-4667-80fb-7adcb1fa05e5): created successfully Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c3b301-8c4e-47a5-b0f9-176c30cd9d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:11:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Flow 'volume_create_manager' (b215b7b2-c975-4116-ae2c-c276729f6658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:11:54 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-bd161da3-ef37-4149-8029-d00d3c426265 tempest-VolumesActionsTest-960258109 None] Created volume successfully. Apr 29 09:11:55 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.750s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:55 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:55 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Deleted volume successfully. Apr 29 09:11:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9cded6a-d0ff-4f56-9948-17871d56dfc2 tempest-VolumeSnapshotQuotasNegativeTestJSON-43230791 None] Lock "cinder-9ad1fb85-244d-410f-9cd6-f7a065a85733-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Acquiring lock "cinder-24d2f227-c3ff-4667-80fb-7adcb1fa05e5-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Lock "cinder-24d2f227-c3ff-4667-80fb-7adcb1fa05e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Acquiring lock "cinder-quobyte-24d2f227-c3ff-4667-80fb-7adcb1fa05e5" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:11:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Lock "cinder-quobyte-24d2f227-c3ff-4667-80fb-7adcb1fa05e5" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:11:57 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1987e7d3-345d-42c5-9d37-d40dc0d2df80]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:11:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:57 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 Apr 29 09:11:57 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:57 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5" returned: 0 in 0.783s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:57 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5 Apr 29 09:11:57 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:58 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-24d2f227-c3ff-4667-80fb-7adcb1fa05e5" returned: 0 in 0.689s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Lock "cinder-quobyte-24d2f227-c3ff-4667-80fb-7adcb1fa05e5" released by "delete_volume" :: held 1.521s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Created reservations ['deaf3000-0290-4b7b-836c-fe478261fcc0', '8db1bad8-c784-4158-932c-d54458fc2873', '6c0817da-6158-4ef7-a495-87b85520d2e0', '2c432e70-1d33-4196-8f4c-8170e6f3f1ef'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:11:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:11:58 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:11:58 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:11:59 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 29 09:11:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.759s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:11:59 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:11:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Deleted volume successfully. Apr 29 09:11:59 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=105,cinder:UPDATE=126,cinder:INSERT=31,cinder:DELETE=10 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:11:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-061b5a05-985b-4c04-9fd0-d39570a8d353 tempest-VolumesActionsTest-960258109 None] Lock "cinder-24d2f227-c3ff-4667-80fb-7adcb1fa05e5-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=90,cinder:UPDATE=134,cinder:DELETE=11,cinder:INSERT=35 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (c83fd0d4-a4ca-40d4-b49b-fc317641cc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f117922f-1b05-480a-b9f1-38fa5a38b700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f117922f-1b05-480a-b9f1-38fa5a38b700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1509721652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ffc734-f2c7-4311-99a9-f6a184672a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:02Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce7cea5-e713-48d0-a9e1-455fc6cc9cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce7cea5-e713-48d0-a9e1-455fc6cc9cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eff4ac0-62a2-417b-85fe-2b7f0d82eb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eff4ac0-62a2-417b-85fe-2b7f0d82eb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ffc734-f2c7-4311-99a9-f6a184672a89', 'volume_name': 'volume-66ffc734-f2c7-4311-99a9-f6a184672a89', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be925c-6e18-4e30-9541-7fa80ac5b39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be925c-6e18-4e30-9541-7fa80ac5b39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9333c1b2-4b2c-4152-ab0c-6a9d08d70b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:02 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume 66ffc734-f2c7-4311-99a9-f6a184672a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ffc734-f2c7-4311-99a9-f6a184672a89', 'volume_size': 1} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1509721652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ffc734-f2c7-4311-99a9-f6a184672a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:02Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Creating volume 66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:02 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:02 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 1073741824 Apr 29 09:12:02 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:02 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:02 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:03 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 1073741824" returned: 0 in 1.038s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:03 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 Apr 29 09:12:03 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:03 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.863s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:03 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89" returned: 0 in 0.618s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9333c1b2-4b2c-4152-ab0c-6a9d08d70b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ffc734-f2c7-4311-99a9-f6a184672a89', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dd9f05-4f4a-4189-abce-892c63a17726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:03 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume volume-66ffc734-f2c7-4311-99a9-f6a184672a89 (66ffc734-f2c7-4311-99a9-f6a184672a89): created successfully Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dd9f05-4f4a-4189-abce-892c63a17726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (c83fd0d4-a4ca-40d4-b49b-fc317641cc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:03 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4c216128-1d4c-49cc-9fcc-250f61f40aa3 tempest-VolumesSnapshotTestJSON-1523715725 None] Created volume successfully. Apr 29 09:12:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Creating offline snapshot dad30751-a648-44b8-801e-ebcd55c239e7 of volume 66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:12:04 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b72e1-7f30-4cfd-b7cf-b90d07076da8]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:04 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 Apr 29 09:12:04 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:05 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89" returned: 0 in 0.811s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:05 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 1G Apr 29 09:12:05 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:06 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 1G" returned: 0 in 1.018s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ffc734-f2c7-4311-99a9-f6a184672a89 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:06 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ffc734-f2c7-4311-99a9-f6a184672a89 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 Apr 29 09:12:06 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:07 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ffc734-f2c7-4311-99a9-f6a184672a89 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7" returned: 0 in 1.021s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:07 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 is being set with open permissions: ugo+rw Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:07 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 Apr 29 09:12:07 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Flow 'volume_create_manager' (5e1c4599-0948-4430-8681-8ec5618f7be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b6f2f3-4e4f-4713-9d7e-46bced14492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b6f2f3-4e4f-4713-9d7e-46bced14492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1356991983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315785a9-6b59-42a3-9030-4d5e1d06184f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfcd0970fd6442da2970d485b76ca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:07Z,use_quota=True,user_id='d1fe162005564e4e996cf92d51d779e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb483573-47f7-47f1-b544-6077bf3fc3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb483573-47f7-47f1-b544-6077bf3fc3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb3c637-9692-433e-8897-43331b2e03ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb3c637-9692-433e-8897-43331b2e03ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315785a9-6b59-42a3-9030-4d5e1d06184f', 'volume_name': 'volume-315785a9-6b59-42a3-9030-4d5e1d06184f', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548bb279-9404-45b0-a0af-c9655ce6959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548bb279-9404-45b0-a0af-c9655ce6959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600ae873-5e28-4276-a2b0-7a245b051f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:07 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Volume 315785a9-6b59-42a3-9030-4d5e1d06184f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315785a9-6b59-42a3-9030-4d5e1d06184f', 'volume_size': 1} Apr 29 09:12:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:08 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7" returned: 0 in 0.776s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:08 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.info Apr 29 09:12:08 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:08 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.info" returned: 0 in 0.707s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:08 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.info is being set with open permissions: ugo+rw Apr 29 09:12:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:08 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.info Apr 29 09:12:08 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:09 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.info" returned: 0 in 0.674s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.161s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.878s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1356991983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315785a9-6b59-42a3-9030-4d5e1d06184f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfcd0970fd6442da2970d485b76ca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:07Z,use_quota=True,user_id='d1fe162005564e4e996cf92d51d779e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Creating volume 315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:09 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:09 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f 1073741824 Apr 29 09:12:09 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:09 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b965909d-acf8-4a5d-8da7-a0ff72f4c9cf tempest-VolumesSnapshotTestJSON-1523715725 None] Create snapshot completed successfully Apr 29 09:12:10 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f 1073741824" returned: 0 in 0.863s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:10 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f Apr 29 09:12:10 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-dad30751-a648-44b8-801e-ebcd55c239e7-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-dad30751-a648-44b8-801e-ebcd55c239e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-66ffc734-f2c7-4311-99a9-f6a184672a89" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-66ffc734-f2c7-4311-99a9-f6a184672a89" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-dad30751-a648-44b8-801e-ebcd55c239e7" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-dad30751-a648-44b8-801e-ebcd55c239e7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Deleting offline snapshot dad30751-a648-44b8-801e-ebcd55c239e7 of volume 66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] snapshot_file for this snap is: volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ee79d3-6373-4992-b0b7-231e4d96f0f3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:11 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:11 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 Apr 29 09:12:11 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Flow 'volume_create_manager' (f182bb9a-c66f-4002-bb6a-32ca5444ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fd2d1e-1ec0-4474-b820-aba8d88b3e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f" returned: 0 in 0.792s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600ae873-5e28-4276-a2b0-7a245b051f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315785a9-6b59-42a3-9030-4d5e1d06184f', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e1a40f-590a-441f-85c4-c44f96abc63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fd2d1e-1ec0-4474-b820-aba8d88b3e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2118917407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be52b97d-ae84-4011-a2e4-851042aa5ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fca998410848eba8e3e61528badd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:11Z,use_quota=True,user_id='314a37968e3d4fb8955cc2a39edbf1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1424f3f-d37a-4f61-82ea-f99f7140c494),volume_type_id=f1424f3f-d37a-4f61-82ea-f99f7140c494)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5285943c-ed5b-41d3-a44a-8229ecb0c5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5285943c-ed5b-41d3-a44a-8229ecb0c5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141fc6c4-29e4-4c43-8134-e0889ec02d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141fc6c4-29e4-4c43-8134-e0889ec02d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be52b97d-ae84-4011-a2e4-851042aa5ba5', 'volume_name': 'volume-be52b97d-ae84-4011-a2e4-851042aa5ba5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6969ec58-22ef-47d9-a669-7cb4d34927cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6969ec58-22ef-47d9-a669-7cb4d34927cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c049ab85-6722-444b-ac13-6c4e1a1185de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:11 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Volume be52b97d-ae84-4011-a2e4-851042aa5ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be52b97d-ae84-4011-a2e4-851042aa5ba5', 'volume_size': 1} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2118917407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be52b97d-ae84-4011-a2e4-851042aa5ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fca998410848eba8e3e61528badd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:11Z,use_quota=True,user_id='314a37968e3d4fb8955cc2a39edbf1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1424f3f-d37a-4f61-82ea-f99f7140c494),volume_type_id=f1424f3f-d37a-4f61-82ea-f99f7140c494)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Creating volume be52b97d-ae84-4011-a2e4-851042aa5ba5 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:11 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:11 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Volume volume-315785a9-6b59-42a3-9030-4d5e1d06184f (315785a9-6b59-42a3-9030-4d5e1d06184f): created successfully Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e1a40f-590a-441f-85c4-c44f96abc63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Flow 'volume_create_manager' (5e1c4599-0948-4430-8681-8ec5618f7be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:11 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 1073741824 Apr 29 09:12:11 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:11 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-6e326264-7da3-43ba-a6a2-f7beaa163463 tempest-SnapshotDependencyTests-5545989 None] Created volume successfully. Apr 29 09:12:11 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7" returned: 0 in 0.765s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ffc734-f2c7-4311-99a9-f6a184672a89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb3891-bea7-49af-b2cf-66e6ca21024d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:12 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 Apr 29 09:12:12 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:12 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 1073741824" returned: 0 in 0.998s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:12 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 Apr 29 09:12:12 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:12 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89" returned: 0 in 0.907s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:12 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 Apr 29 09:12:12 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:13 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5" returned: 0 in 0.775s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.083s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c049ab85-6722-444b-ac13-6c4e1a1185de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be52b97d-ae84-4011-a2e4-851042aa5ba5', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31970187-8bd6-4852-8694-b55ee001c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Creating offline snapshot 44ec3d37-0adb-4361-aaa9-5805b51a6fd8 of volume 315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:12:13 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Volume volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 (be52b97d-ae84-4011-a2e4-851042aa5ba5): created successfully Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31970187-8bd6-4852-8694-b55ee001c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Flow 'volume_create_manager' (f182bb9a-c66f-4002-bb6a-32ca5444ba19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9828db4-808b-4437-9a54-4f27d26dd14b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-30729437-653f-45d9-aaa2-2bcf526ffa8a tempest-VolumeTypesAccessTest-727861603 None] Created volume successfully. Apr 29 09:12:13 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f Apr 29 09:12:13 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Acquiring lock "cinder-be52b97d-ae84-4011-a2e4-851042aa5ba5-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Lock "cinder-be52b97d-ae84-4011-a2e4-851042aa5ba5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Acquiring lock "cinder-quobyte-be52b97d-ae84-4011-a2e4-851042aa5ba5" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Lock "cinder-quobyte-be52b97d-ae84-4011-a2e4-851042aa5ba5" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd23c994-80ea-4b4f-a840-24d0b0b253d6]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:13 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 Apr 29 09:12:13 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:13 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7" returned: 0 in 0.987s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:13 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7 Apr 29 09:12:13 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:14 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f" returned: 0 in 1.088s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:14 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 1G Apr 29 09:12:14 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:14 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5" returned: 0 in 0.887s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:14 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5 Apr 29 09:12:14 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:14 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89.dad30751-a648-44b8-801e-ebcd55c239e7" returned: 0 in 0.773s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-dad30751-a648-44b8-801e-ebcd55c239e7" released by "_delete_snapshot" :: held 3.672s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-66ffc734-f2c7-4311-99a9-f6a184672a89" released by "delete_snapshot" :: held 3.702s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['d5cb6190-ff8b-4ab0-afea-25c234c4a3c0', '1f23a3f4-aa5e-4c3b-a3dd-55b47848c594', '3d22e0e7-5bf6-4900-aac1-0a77c0863df0', 'c5aad411-1f60-4f2d-b830-839964c31e14'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:14 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Delete snapshot completed successfully. Apr 29 09:12:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-5f2277dc-97d4-47c0-84e6-b457faada28c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-dad30751-a648-44b8-801e-ebcd55c239e7-delete_snapshot" released by "delete_snapshot" :: held 3.962s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:15 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 1G" returned: 0 in 0.899s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315785a9-6b59-42a3-9030-4d5e1d06184f -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:15 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315785a9-6b59-42a3-9030-4d5e1d06184f -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 Apr 29 09:12:15 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:15 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-be52b97d-ae84-4011-a2e4-851042aa5ba5" returned: 0 in 0.815s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Lock "cinder-quobyte-be52b97d-ae84-4011-a2e4-851042aa5ba5" released by "delete_volume" :: held 1.771s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:15 devstack cinder-volume[84004]: WARNING cinder.quota [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-424654534 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-424654534, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:12:15 devstack cinder-volume[84004]: WARNING cinder.quota [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-424654534 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-424654534, it is now deprecated. Please use the default quota class for default quota. Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Created reservations ['3e4dbd63-45ff-4a28-8e4c-e08efdf56269', 'cfa604b5-acec-48fd-afd0-af07c9e27f02', 'ff742ec6-58d7-47ff-9566-fab0305bac03', '58044e9b-5f8f-43fe-9d4b-f2dcce185d5c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:15 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:15 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (4716b711-4db2-4a8d-84ba-f868f02e2ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1fe395-9bf4-48c0-a074-8632360ff54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1fe395-9bf4-48c0-a074-8632360ff54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1621095506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc9d371-3420-49d7-bb9e-e38536161fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:16Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5541e450-a191-421c-b41f-78380cb6ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5541e450-a191-421c-b41f-78380cb6ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269f12d3-d1e7-40bf-ae33-a0f96e8433db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269f12d3-d1e7-40bf-ae33-a0f96e8433db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc9d371-3420-49d7-bb9e-e38536161fbf', 'volume_name': 'volume-dfc9d371-3420-49d7-bb9e-e38536161fbf', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4800b313-ba7d-4135-988a-49ddbab317a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4800b313-ba7d-4135-988a-49ddbab317a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3e04a8-fa67-4461-9b5f-14d3d0fa5365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:16 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume dfc9d371-3420-49d7-bb9e-e38536161fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc9d371-3420-49d7-bb9e-e38536161fbf', 'volume_size': 1} Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:16 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315785a9-6b59-42a3-9030-4d5e1d06184f -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8" returned: 0 in 0.984s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:16 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 is being set with open permissions: ugo+rw Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:16 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 Apr 29 09:12:16 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:16 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.884s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:16 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Deleted volume successfully. Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23e3ac47-b87c-4710-a0f3-18d6499e9e4d tempest-VolumeTypesAccessTest-727861603 None] Lock "cinder-be52b97d-ae84-4011-a2e4-851042aa5ba5-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:16 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8" returned: 0 in 0.653s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:16 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.info Apr 29 09:12:16 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:17 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.info" returned: 0 in 0.627s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:17 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.info is being set with open permissions: ugo+rw Apr 29 09:12:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:17 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.info Apr 29 09:12:17 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:18 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.info" returned: 0 in 0.625s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.215s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1621095506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc9d371-3420-49d7-bb9e-e38536161fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:16Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Creating volume dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:18 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:18 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf 1073741824 Apr 29 09:12:18 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4bae1f96-7adc-4dea-b051-46dcf99c3ff4 tempest-SnapshotDependencyTests-5545989 None] Create snapshot completed successfully Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Flow 'volume_create_manager' (762ce259-8e03-48ec-80ae-4f0cd298c074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba09fc2-502a-4cc5-879f-d655baf6d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba09fc2-502a-4cc5-879f-d655baf6d143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25797e33-8287-4a63-9620-9e82793a8dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfcd0970fd6442da2970d485b76ca8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44ec3d37-0adb-4361-aaa9-5805b51a6fd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:19Z,use_quota=True,user_id='d1fe162005564e4e996cf92d51d779e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39593322-ee23-4f52-a486-ca821c729b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39593322-ee23-4f52-a486-ca821c729b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007e2a67-bab4-4d68-aae9-f192f168f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007e2a67-bab4-4d68-aae9-f192f168f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25797e33-8287-4a63-9620-9e82793a8dba', 'volume_name': 'volume-25797e33-8287-4a63-9620-9e82793a8dba', 'volume_size': 1, 'snapshot_id': '44ec3d37-0adb-4361-aaa9-5805b51a6fd8'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2cc94c-949f-4d20-8873-afa3c4c46f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2cc94c-949f-4d20-8873-afa3c4c46f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf041a94-5610-406c-a415-df4d216f8c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:19 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Volume 25797e33-8287-4a63-9620-9e82793a8dba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25797e33-8287-4a63-9620-9e82793a8dba', 'volume_size': 1, 'snapshot_id': '44ec3d37-0adb-4361-aaa9-5805b51a6fd8'} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:19 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf 1073741824" returned: 0 in 1.222s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:19 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf Apr 29 09:12:19 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:20 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf" returned: 0 in 0.696s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.818s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-quobyte-44ec3d37-0adb-4361-aaa9-5805b51a6fd8-25797e33-8287-4a63-9620-9e82793a8dba" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3e04a8-fa67-4461-9b5f-14d3d0fa5365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc9d371-3420-49d7-bb9e-e38536161fbf', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fad8b5-5659-4170-b2a9-87920df48e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-44ec3d37-0adb-4361-aaa9-5805b51a6fd8-25797e33-8287-4a63-9620-9e82793a8dba" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Creating volume 25797e33-8287-4a63-9620-9e82793a8dba from snapshot 44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-quobyte-25797e33-8287-4a63-9620-9e82793a8dba" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:20 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume volume-dfc9d371-3420-49d7-bb9e-e38536161fbf (dfc9d371-3420-49d7-bb9e-e38536161fbf): created successfully Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fad8b5-5659-4170-b2a9-87920df48e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (4716b711-4db2-4a8d-84ba-f868f02e2ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-25797e33-8287-4a63-9620-9e82793a8dba" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] snapshot: 44ec3d37-0adb-4361-aaa9-5805b51a6fd8, volume: 25797e33-8287-4a63-9620-9e82793a8dba, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:12:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-02c7b2ae-be63-4b8e-ae1b-f256abef86f5 tempest-VolumesSnapshotTestJSON-1523715725 None] Created volume successfully. Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0c4859-66d0-40fa-bc01-150b4adfafba]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:20 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 Apr 29 09:12:20 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:21 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8" returned: 0 in 0.742s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-315785a9-6b59-42a3-9030-4d5e1d06184f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e278bbda-b34f-4e34-b594-cd79f3426572]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:21 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f Apr 29 09:12:21 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:21 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f" returned: 0 in 0.806s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:12:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:21 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba Apr 29 09:12:21 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:23 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Flow 'volume_create_manager' (9732c172-9833-41a5-a51b-1ea7f12fcadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:23 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2a9ffd-098a-4079-a7da-1cf17661e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2a9ffd-098a-4079-a7da-1cf17661e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1516424188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4dd354-d80a-418f-b8b8-9d7e6848e411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b16e986b0f4f1ba9960b2433516544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:24Z,use_quota=True,user_id='f6e63f8432284126a32e9de4db787b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c42f2a-829c-4d03-8352-d7864fb2af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c42f2a-829c-4d03-8352-d7864fb2af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d88a7b3-2819-495a-b4c8-823bae46c266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d88a7b3-2819-495a-b4c8-823bae46c266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f4dd354-d80a-418f-b8b8-9d7e6848e411', 'volume_name': 'volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b26f3-807d-4553-9fdb-220949d96ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b26f3-807d-4553-9fdb-220949d96ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616a2018-b776-463f-b427-d288779824cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:24 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Volume 5f4dd354-d80a-418f-b8b8-9d7e6848e411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411', 'volume_size': 1} Apr 29 09:12:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:27 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba" returned: 0 in 5.473s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:27 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f286a2-6ac2-4c52-8cbd-18519f5d2b06]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:27 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f Apr 29 09:12:27 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:28 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f" returned: 0 in 0.889s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:12:28 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Converted 1024.00 MB image at 187.07 MB/s Apr 29 09:12:28 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba is being set with open permissions: ugo+rw Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:28 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba Apr 29 09:12:28 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:28 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba" returned: 0 in 0.617s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-25797e33-8287-4a63-9620-9e82793a8dba" released by "_copy_volume_from_snapshot" :: held 8.635s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-44ec3d37-0adb-4361-aaa9-5805b51a6fd8-25797e33-8287-4a63-9620-9e82793a8dba" released by "_create_volume_from_snapshot" :: held 8.693s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.734s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.464s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Creating offline snapshot 84ff88f2-8b43-4fb4-919a-1bd1ff387152 of volume dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf041a94-5610-406c-a415-df4d216f8c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25797e33-8287-4a63-9620-9e82793a8dba', 'volume_size': 1, 'snapshot_id': '44ec3d37-0adb-4361-aaa9-5805b51a6fd8'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d7e75e-20bd-4f39-b094-9db01827178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fec8d6-4dfd-4f74-bff0-9f61fbb5b364]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Volume volume-25797e33-8287-4a63-9620-9e82793a8dba (25797e33-8287-4a63-9620-9e82793a8dba): created successfully Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d7e75e-20bd-4f39-b094-9db01827178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Flow 'volume_create_manager' (762ce259-8e03-48ec-80ae-4f0cd298c074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-73049405-3231-4313-9d64-e8e6d8cd6149 tempest-SnapshotDependencyTests-5545989 None] Created volume successfully. Apr 29 09:12:29 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf Apr 29 09:12:29 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-44ec3d37-0adb-4361-aaa9-5805b51a6fd8-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-44ec3d37-0adb-4361-aaa9-5805b51a6fd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-quobyte-315785a9-6b59-42a3-9030-4d5e1d06184f" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-315785a9-6b59-42a3-9030-4d5e1d06184f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-quobyte-44ec3d37-0adb-4361-aaa9-5805b51a6fd8" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-44ec3d37-0adb-4361-aaa9-5805b51a6fd8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Deleting offline snapshot 44ec3d37-0adb-4361-aaa9-5805b51a6fd8 of volume 315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] snapshot_file for this snap is: volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f83367e-c7ac-4e4a-ba27-c09032ab1d5b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:29 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 Apr 29 09:12:29 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:29 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf" returned: 0 in 0.732s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:29 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 1G Apr 29 09:12:29 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:30 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8" returned: 0 in 0.738s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-315785a9-6b59-42a3-9030-4d5e1d06184f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f1c64-cdf6-4253-8483-af56967a1ae9]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:30 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f Apr 29 09:12:30 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:30 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 1G" returned: 0 in 0.803s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9d371-3420-49d7-bb9e-e38536161fbf -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:30 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9d371-3420-49d7-bb9e-e38536161fbf -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 Apr 29 09:12:30 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:30 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f" returned: 0 in 0.741s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:31 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 Apr 29 09:12:31 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:31 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9d371-3420-49d7-bb9e-e38536161fbf -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152" returned: 0 in 0.677s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:31 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 is being set with open permissions: ugo+rw Apr 29 09:12:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:31 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 Apr 29 09:12:31 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:31 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8" returned: 0 in 0.739s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:31 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8 Apr 29 09:12:31 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:31 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152" returned: 0 in 0.665s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:31 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.info Apr 29 09:12:31 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:32 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f.44ec3d37-0adb-4361-aaa9-5805b51a6fd8" returned: 0 in 0.612s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-44ec3d37-0adb-4361-aaa9-5805b51a6fd8" released by "_delete_snapshot" :: held 2.961s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-315785a9-6b59-42a3-9030-4d5e1d06184f" released by "delete_snapshot" :: held 2.990s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Created reservations ['dc2d9a4c-1df5-4357-bef2-70fd3ef01696', 'ed6b0f92-6a2d-4db6-bb0d-194d1a26108a', '7ce8b166-a8d7-469f-969e-157874b4b244', '727b2935-d1a8-48e2-908e-c88afd065c4b'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Delete snapshot completed successfully. Apr 29 09:12:32 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.info" returned: 0 in 0.646s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:32 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.info is being set with open permissions: ugo+rw Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b915a243-1207-4854-81e3-885593e21ff7 tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-44ec3d37-0adb-4361-aaa9-5805b51a6fd8-delete_snapshot" released by "delete_snapshot" :: held 3.204s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:32 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.info Apr 29 09:12:32 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-315785a9-6b59-42a3-9030-4d5e1d06184f-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-315785a9-6b59-42a3-9030-4d5e1d06184f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-quobyte-315785a9-6b59-42a3-9030-4d5e1d06184f" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-315785a9-6b59-42a3-9030-4d5e1d06184f" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae9c292-f4f8-402b-bc16-38324a9e7bba]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:32 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f Apr 29 09:12:32 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:33 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.info" returned: 0 in 0.646s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.286s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.135s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1516424188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4dd354-d80a-418f-b8b8-9d7e6848e411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b16e986b0f4f1ba9960b2433516544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:24Z,use_quota=True,user_id='f6e63f8432284126a32e9de4db787b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Creating volume 5f4dd354-d80a-418f-b8b8-9d7e6848e411 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:33 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:33 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 1073741824 Apr 29 09:12:33 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-bfc27765-fd17-45e7-81fb-5a25171ada4d tempest-VolumesSnapshotTestJSON-1523715725 None] Create snapshot completed successfully Apr 29 09:12:33 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f" returned: 0 in 0.866s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:33 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f Apr 29 09:12:33 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (5ebd9db2-d0df-4f63-8018-ab0a6a1ca125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b367d395-ff2e-4e85-828e-54333e6b9a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b367d395-ff2e-4e85-828e-54333e6b9a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-77978053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fa1204-94a7-4ae2-a42d-e40be30c48db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=84ff88f2-8b43-4fb4-919a-1bd1ff387152,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:34Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0439d624-53cd-4470-ba2f-7f32042da9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0439d624-53cd-4470-ba2f-7f32042da9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6561da99-2325-445e-9591-946ff990dee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6561da99-2325-445e-9591-946ff990dee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60fa1204-94a7-4ae2-a42d-e40be30c48db', 'volume_name': 'volume-60fa1204-94a7-4ae2-a42d-e40be30c48db', 'volume_size': 2, 'snapshot_id': '84ff88f2-8b43-4fb4-919a-1bd1ff387152'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff818bc4-7824-4ac6-804a-91df18555c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff818bc4-7824-4ac6-804a-91df18555c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82917e73-76ee-4963-9978-86bb4403f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:34 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Volume 60fa1204-94a7-4ae2-a42d-e40be30c48db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60fa1204-94a7-4ae2-a42d-e40be30c48db', 'volume_size': 2, 'snapshot_id': '84ff88f2-8b43-4fb4-919a-1bd1ff387152'} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:34 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 1073741824" returned: 0 in 1.020s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:34 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 Apr 29 09:12:34 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:34 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-315785a9-6b59-42a3-9030-4d5e1d06184f" returned: 0 in 0.813s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-315785a9-6b59-42a3-9030-4d5e1d06184f" released by "delete_volume" :: held 1.745s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Created reservations ['258cebfe-36a7-4efb-ae1a-f4fa0f9a3e1b', '9175667f-2624-473b-bea7-73447809d2a3', 'c006585d-acee-4031-9430-06d650dc5b36', '01380c78-2d55-4e38-95ef-b0a7f8522de0'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:34 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:34 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-25797e33-8287-4a63-9620-9e82793a8dba-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:34 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.841s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-84ff88f2-8b43-4fb4-919a-1bd1ff387152-60fa1204-94a7-4ae2-a42d-e40be30c48db" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-25797e33-8287-4a63-9620-9e82793a8dba-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616a2018-b776-463f-b427-d288779824cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed1a17d-cb93-482f-af8e-9503d0984256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-84ff88f2-8b43-4fb4-919a-1bd1ff387152-60fa1204-94a7-4ae2-a42d-e40be30c48db" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Creating volume 60fa1204-94a7-4ae2-a42d-e40be30c48db from snapshot 84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-60fa1204-94a7-4ae2-a42d-e40be30c48db" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:35 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Volume volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 (5f4dd354-d80a-418f-b8b8-9d7e6848e411): created successfully Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed1a17d-cb93-482f-af8e-9503d0984256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Flow 'volume_create_manager' (9732c172-9833-41a5-a51b-1ea7f12fcadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-60fa1204-94a7-4ae2-a42d-e40be30c48db" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] snapshot: 84ff88f2-8b43-4fb4-919a-1bd1ff387152, volume: 60fa1204-94a7-4ae2-a42d-e40be30c48db, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:12:35 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7ca8e873-edba-4d1f-8f3f-3710ae2afd7e tempest-VolumesTransfersV355Test-1113575753 None] Created volume successfully. Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "cinder-quobyte-25797e33-8287-4a63-9620-9e82793a8dba" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1275cba0-4cf4-4d2b-babf-d69b8ad73656]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-25797e33-8287-4a63-9620-9e82793a8dba" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb385e10-f4cf-4d7f-bae4-52ddca5b3a8f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:35 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.699s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:35 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:35 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:35 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Deleted volume successfully. Apr 29 09:12:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-da02acfa-c32c-4566-aa72-18958cae637a tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-315785a9-6b59-42a3-9030-4d5e1d06184f-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:35 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba Apr 29 09:12:35 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:36 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152" returned: 0 in 0.857s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc9d371-3420-49d7-bb9e-e38536161fbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[19605fb4-e1d5-4a33-9676-efb3f30adffd]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:36 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba" returned: 0 in 0.856s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:36 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba Apr 29 09:12:36 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:36 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf Apr 29 09:12:36 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1b6a11ab-c1ca-4c36-b1bc-29591f7ab072 tempest-VolumesTransfersV355Test-133275658 None] Transfer volume completed successfully. Apr 29 09:12:36 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-25797e33-8287-4a63-9620-9e82793a8dba" returned: 0 in 0.781s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-quobyte-25797e33-8287-4a63-9620-9e82793a8dba" released by "delete_volume" :: held 1.699s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:36 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Created reservations ['5a8d3043-2c1e-4b8c-94b2-9510f76133da', '96801992-91bd-4d32-bba2-69956a8ca67a', '89277428-2df9-4af4-ac94-e4a425e09b77', '016d6b5a-fa4f-46c3-a557-cab216c11ab8'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf" returned: 0 in 0.902s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:12:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:37 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db Apr 29 09:12:37 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:37 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:37 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:37 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.648s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Deleted volume successfully. Apr 29 09:12:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-af71001d-7419-44a5-beaf-a2d79d8d404e tempest-SnapshotDependencyTests-5545989 None] Lock "cinder-25797e33-8287-4a63-9620-9e82793a8dba-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Acquiring lock "cinder-5f4dd354-d80a-418f-b8b8-9d7e6848e411-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-5f4dd354-d80a-418f-b8b8-9d7e6848e411-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Acquiring lock "cinder-quobyte-5f4dd354-d80a-418f-b8b8-9d7e6848e411" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-quobyte-5f4dd354-d80a-418f-b8b8-9d7e6848e411" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:38 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5c49a-2695-474f-b2ec-68e8ad714f2a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:38 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 Apr 29 09:12:38 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:40 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411" returned: 0 in 1.721s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:40 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411 Apr 29 09:12:40 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:42 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5f4dd354-d80a-418f-b8b8-9d7e6848e411" returned: 0 in 2.068s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-quobyte-5f4dd354-d80a-418f-b8b8-9d7e6848e411" released by "delete_volume" :: held 3.896s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Created reservations ['ae6d56d9-158e-4152-abf8-36f07c610a05', '0eeedb60-7b39-43be-95ea-f8a7730c293e', '1ed2f3c4-8fd6-4020-92e6-b9b0df4f3a0b', '5a071435-d200-4e4d-ab5b-26bab5f3e267'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:42 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:42 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:43 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db" returned: 0 in 6.657s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:43 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a57f50-db69-488e-8565-2ed34627688a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:43 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf Apr 29 09:12:43 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:44 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Flow 'volume_create_manager' (bcded149-f602-4451-8efc-cc7ad3ff9d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2fa6c0-928c-436c-a5ed-a0bcc65af8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.166s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2fa6c0-928c-436c-a5ed-a0bcc65af8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-170464324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b16e986b0f4f1ba9960b2433516544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:44Z,use_quota=True,user_id='f6e63f8432284126a32e9de4db787b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa11762-b774-43cc-9f14-45a48a482dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa11762-b774-43cc-9f14-45a48a482dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d5f8b3-0251-43d9-afb7-3e893a58ce87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d5f8b3-0251-43d9-afb7-3e893a58ce87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d', 'volume_name': 'volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ef1259-6b20-4dc7-ae75-2bb085abf80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ef1259-6b20-4dc7-ae75-2bb085abf80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e93d86-181f-4b61-9d07-85277d088e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:44 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Volume 6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d', 'volume_size': 1} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:44 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Deleted volume successfully. Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4459e6f3-a44e-467b-89cd-637c6c0aab81 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-5f4dd354-d80a-418f-b8b8-9d7e6848e411-delete_volume" released by "delete_volume" :: held 5.789s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:44 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf" returned: 0 in 1.104s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:12:44 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Converted 1024.00 MB image at 153.79 MB/s Apr 29 09:12:44 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db is being set with open permissions: ugo+rw Apr 29 09:12:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:44 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db Apr 29 09:12:44 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Flow 'volume_create_manager' (d0f7e58e-0be3-429a-bc11-3724a2d64411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d80d3a-f948-41d2-8fca-da511ef501e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d80d3a-f948-41d2-8fca-da511ef501e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-145941115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5debcf34-84d7-4e50-aa8d-3b833570cba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcade3450014f49bbb7f50a322e910c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:45Z,use_quota=True,user_id='801e6eeaed04404c8998d3d04034ee2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa5131-95ac-455c-94e3-ace23b08489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa5131-95ac-455c-94e3-ace23b08489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ace2c6-c194-4fe6-b820-b992c694bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ace2c6-c194-4fe6-b820-b992c694bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5debcf34-84d7-4e50-aa8d-3b833570cba7', 'volume_name': 'volume-5debcf34-84d7-4e50-aa8d-3b833570cba7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8222af06-b9da-4e16-a9bc-9c10518e61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8222af06-b9da-4e16-a9bc-9c10518e61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cf0f91-e2f9-443e-9679-80967f6eb217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:45 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Volume 5debcf34-84d7-4e50-aa8d-3b833570cba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5debcf34-84d7-4e50-aa8d-3b833570cba7', 'volume_size': 1} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:45 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db" returned: 0 in 0.734s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-60fa1204-94a7-4ae2-a42d-e40be30c48db" released by "_copy_volume_from_snapshot" :: held 10.388s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-84ff88f2-8b43-4fb4-919a-1bd1ff387152-60fa1204-94a7-4ae2-a42d-e40be30c48db" released by "_create_volume_from_snapshot" :: held 10.446s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.509s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-170464324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b16e986b0f4f1ba9960b2433516544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:44Z,use_quota=True,user_id='f6e63f8432284126a32e9de4db787b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Creating volume 6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:45 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:45 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d 1073741824 Apr 29 09:12:45 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82917e73-76ee-4963-9978-86bb4403f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fa1204-94a7-4ae2-a42d-e40be30c48db', 'volume_size': 2, 'snapshot_id': '84ff88f2-8b43-4fb4-919a-1bd1ff387152'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645273d5-b9bf-4c12-8c02-4f3a6518ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:45 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Volume volume-60fa1204-94a7-4ae2-a42d-e40be30c48db (60fa1204-94a7-4ae2-a42d-e40be30c48db): created successfully Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645273d5-b9bf-4c12-8c02-4f3a6518ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:45 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (5ebd9db2-d0df-4f63-8018-ab0a6a1ca125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:45 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-202913b5-acdd-4261-bf5b-749b576d3e0c tempest-VolumesSnapshotTestJSON-1523715725 None] Created volume successfully. Apr 29 09:12:46 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d 1073741824" returned: 0 in 0.878s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:46 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d Apr 29 09:12:46 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-60fa1204-94a7-4ae2-a42d-e40be30c48db-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-60fa1204-94a7-4ae2-a42d-e40be30c48db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-60fa1204-94a7-4ae2-a42d-e40be30c48db" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-60fa1204-94a7-4ae2-a42d-e40be30c48db" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a14263-14e3-42a3-9509-5eac2662536b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:46 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db Apr 29 09:12:46 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:47 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.916s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-145941115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5debcf34-84d7-4e50-aa8d-3b833570cba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcade3450014f49bbb7f50a322e910c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:45Z,use_quota=True,user_id='801e6eeaed04404c8998d3d04034ee2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Creating volume 5debcf34-84d7-4e50-aa8d-3b833570cba7 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:47 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e93d86-181f-4b61-9d07-85277d088e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:47 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 1073741824 Apr 29 09:12:47 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13e1223-3856-4c4b-90d7-fcc10c3a75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:47 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Volume volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d (6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d): created successfully Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13e1223-3856-4c4b-90d7-fcc10c3a75c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Flow 'volume_create_manager' (bcded149-f602-4451-8efc-cc7ad3ff9d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:47 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8ba5daf8-2d38-4e2b-a6c6-4ee3c67b2d91 tempest-VolumesTransfersV355Test-1113575753 None] Created volume successfully. Apr 29 09:12:47 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db" returned: 0 in 0.790s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:47 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db Apr 29 09:12:47 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Acquiring lock "cinder-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Acquiring lock "cinder-quobyte-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-quobyte-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b04d4-9fa8-4e43-b26c-5504cdc43917]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:47 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d Apr 29 09:12:47 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:48 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 1073741824" returned: 0 in 0.961s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:48 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 Apr 29 09:12:48 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:48 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-60fa1204-94a7-4ae2-a42d-e40be30c48db" returned: 0 in 0.822s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-60fa1204-94a7-4ae2-a42d-e40be30c48db" released by "delete_volume" :: held 1.662s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['54885604-259a-469f-a3e0-9c77bdf1a31e', '22f1cc05-3b6b-48e5-b701-f4b914dea26b', 'bf8d9d1b-3460-47bf-a4a4-69fbb114cfef', '33cc4587-6536-484e-a4ee-d8d22517aee3'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:48 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:48 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:48 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d" returned: 0 in 1.019s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:48 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7" returned: 0 in 0.788s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:48 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d Apr 29 09:12:48 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-84ff88f2-8b43-4fb4-919a-1bd1ff387152-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cf0f91-e2f9-443e-9679-80967f6eb217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5debcf34-84d7-4e50-aa8d-3b833570cba7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef3f7d7-423c-49d2-9cc9-7fbc5587f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-84ff88f2-8b43-4fb4-919a-1bd1ff387152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-dfc9d371-3420-49d7-bb9e-e38536161fbf" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:48 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Volume volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 (5debcf34-84d7-4e50-aa8d-3b833570cba7): created successfully Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef3f7d7-423c-49d2-9cc9-7fbc5587f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Flow 'volume_create_manager' (d0f7e58e-0be3-429a-bc11-3724a2d64411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-dfc9d371-3420-49d7-bb9e-e38536161fbf" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-84ff88f2-8b43-4fb4-919a-1bd1ff387152" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:49 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-087b367d-2093-4c68-b95a-9e98de6f0cbe tempest-VolumesMetadataTest-124233545 None] Created volume successfully. Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-84ff88f2-8b43-4fb4-919a-1bd1ff387152" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Deleting offline snapshot 84ff88f2-8b43-4fb4-919a-1bd1ff387152 of volume dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] snapshot_file for this snap is: volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd573be-5cb4-4de5-a700-44c2b6b36ad3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:49 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.759s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:49 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Deleted volume successfully. Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bacc4141-f1d7-4653-a2ad-f6e30a456d29 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-60fa1204-94a7-4ae2-a42d-e40be30c48db-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:49 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 Apr 29 09:12:49 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:49 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d" returned: 0 in 0.758s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-quobyte-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d" released by "delete_volume" :: held 1.834s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Created reservations ['5bd204f5-197e-4530-a46a-6e8c4810faf1', 'd64c7f03-03cb-45b1-bcdd-0d3906763f12', 'e6cc1ebe-7db2-43fe-8789-0cec61fcf917', 'e8f66045-d176-41ee-b431-fc7d7d6ea191'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:49 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:49 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:50 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152" returned: 0 in 0.983s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc9d371-3420-49d7-bb9e-e38536161fbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c26fce-6124-43e9-96b1-30563612c98d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:50 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf Apr 29 09:12:50 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Acquiring lock "cinder-5debcf34-84d7-4e50-aa8d-3b833570cba7-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Lock "cinder-5debcf34-84d7-4e50-aa8d-3b833570cba7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Acquiring lock "cinder-quobyte-5debcf34-84d7-4e50-aa8d-3b833570cba7" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Lock "cinder-quobyte-5debcf34-84d7-4e50-aa8d-3b833570cba7" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f3d6a-d185-4aa8-aa80-758e42767793]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:50 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.787s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:50 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Deleted volume successfully. Apr 29 09:12:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e058a286-1ca1-4beb-a308-0485f9983d47 tempest-VolumesTransfersV355Test-1451444488 None] Lock "cinder-6ac4eb6d-3a2b-48a6-85ff-592f72b5eb9d-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:50 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 Apr 29 09:12:50 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:51 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf" returned: 0 in 1.109s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:51 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 Apr 29 09:12:51 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:51 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7" returned: 0 in 0.912s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:51 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7 Apr 29 09:12:51 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:52 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152" returned: 0 in 0.858s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:52 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152 Apr 29 09:12:52 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:52 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5debcf34-84d7-4e50-aa8d-3b833570cba7" returned: 0 in 0.872s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Lock "cinder-quobyte-5debcf34-84d7-4e50-aa8d-3b833570cba7" released by "delete_volume" :: held 1.860s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Created reservations ['03dd5b7e-8b97-45d9-bc76-065bf55e7eab', '5ef23b1e-a8ec-4577-a467-c7b151baf6e1', 'f5a22a09-28d7-4d42-b0e3-f8abe5e193f7', '45474c35-9581-4894-9aef-5c9cb03eb9bb'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:52 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:52 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:52 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf.84ff88f2-8b43-4fb4-919a-1bd1ff387152" returned: 0 in 0.745s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-84ff88f2-8b43-4fb4-919a-1bd1ff387152" released by "_delete_snapshot" :: held 3.874s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-dfc9d371-3420-49d7-bb9e-e38536161fbf" released by "delete_snapshot" :: held 3.916s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['110ba46b-f897-42af-bfc4-492bfc0eed84', '2648f148-192c-4961-b63b-fc39fba0129f', 'fa1d863c-776b-4efe-bd6d-4453204b5632', '9de86ba9-ec91-4135-88ab-2dea22fed9f7'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Delete snapshot completed successfully. Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-18f96a63-ccb7-4964-b679-ab4a76780598 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-84ff88f2-8b43-4fb4-919a-1bd1ff387152-delete_snapshot" released by "delete_snapshot" :: held 4.241s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-dfc9d371-3420-49d7-bb9e-e38536161fbf-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-dfc9d371-3420-49d7-bb9e-e38536161fbf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:53 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.845s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-dfc9d371-3420-49d7-bb9e-e38536161fbf" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:12:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Deleted volume successfully. Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-dfc9d371-3420-49d7-bb9e-e38536161fbf" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1ca003be-01ea-4ff9-a837-b6b100565a03 tempest-VolumesMetadataTest-124233545 None] Lock "cinder-5debcf34-84d7-4e50-aa8d-3b833570cba7-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d0156-3880-44d8-85b3-45b51821e22c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:12:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:53 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf Apr 29 09:12:53 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:54 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf" returned: 0 in 0.813s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:54 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf Apr 29 09:12:54 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:55 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-dfc9d371-3420-49d7-bb9e-e38536161fbf" returned: 0 in 0.678s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-dfc9d371-3420-49d7-bb9e-e38536161fbf" released by "delete_volume" :: held 1.581s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['ec650453-1831-4f67-a560-68426b3df1c0', '14076bba-5f81-495b-bf8d-874a15a38fd3', 'c354d096-3623-4031-9b0b-20ba94c82631', '8e0a0f08-7744-4989-ab99-228775e052ab'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:55 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:12:55 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:55 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.661s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:12:55 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Deleted volume successfully. Apr 29 09:12:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0b6e7c86-ba2b-4e13-914c-de9be9553a37 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-dfc9d371-3420-49d7-bb9e-e38536161fbf-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (f9facc46-dd0d-4ceb-b1d4-3983c0281bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e2c23b-c47a-4029-8a02-944fbdf72b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e2c23b-c47a-4029-8a02-944fbdf72b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1735838408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa45a8be-ca6b-4fbf-93ed-2ec37dce3339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:56Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2539ef5b-de58-4178-b341-cdf0c5b0c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2539ef5b-de58-4178-b341-cdf0c5b0c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1b559d-90c0-4d5b-b006-929341320459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1b559d-90c0-4d5b-b006-929341320459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa45a8be-ca6b-4fbf-93ed-2ec37dce3339', 'volume_name': 'volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c3bacf-d0bb-44fd-8272-fef8d727367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c3bacf-d0bb-44fd-8272-fef8d727367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af3df07-15e7-4da7-a1e0-efaf2923f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:56 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume aa45a8be-ca6b-4fbf-93ed-2ec37dce3339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339', 'volume_size': 1} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1735838408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa45a8be-ca6b-4fbf-93ed-2ec37dce3339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:56Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Creating volume aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:56 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:56 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 1073741824 Apr 29 09:12:56 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (e91b78d1-7d5a-4e6b-852c-183125f31a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0524a84f-1110-48f1-946c-dc27bf9f977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0524a84f-1110-48f1-946c-dc27bf9f977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-391536631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604cbf84-746e-489f-975d-85e49adaf2b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:57Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a56be6-1426-4393-85fa-2f1dab38cad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a56be6-1426-4393-85fa-2f1dab38cad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc3ad09-a1d9-4a5b-981f-aa2a5f2204b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc3ad09-a1d9-4a5b-981f-aa2a5f2204b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604cbf84-746e-489f-975d-85e49adaf2b1', 'volume_name': 'volume-604cbf84-746e-489f-975d-85e49adaf2b1', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952dde82-ce81-40f3-ab32-98c72aa6dc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952dde82-ce81-40f3-ab32-98c72aa6dc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82022921-e5d2-4d62-b1d8-de6e9b483d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:57 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Volume 604cbf84-746e-489f-975d-85e49adaf2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604cbf84-746e-489f-975d-85e49adaf2b1', 'volume_size': 1} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:57 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 1073741824" returned: 0 in 0.942s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:57 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 Apr 29 09:12:57 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:57 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" returned: 0 in 0.606s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-391536631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604cbf84-746e-489f-975d-85e49adaf2b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:57Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Creating volume 604cbf84-746e-489f-975d-85e49adaf2b1 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:57 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:57 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 1073741824 Apr 29 09:12:57 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af3df07-15e7-4da7-a1e0-efaf2923f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97576da7-173f-4f8f-9701-1a9f58a7869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Volume volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 (aa45a8be-ca6b-4fbf-93ed-2ec37dce3339): created successfully Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97576da7-173f-4f8f-9701-1a9f58a7869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (f9facc46-dd0d-4ceb-b1d4-3983c0281bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c55cdb1e-a44a-4e5e-ae48-c019b93f9381 tempest-VolumesSnapshotTestJSON-1523715725 None] Created volume successfully. Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Flow 'volume_create_manager' (8733aa1e-9a6f-4a85-8df8-ab958f46159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad0ab7-3d73-47f1-924e-3a12939799be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad0ab7-3d73-47f1-924e-3a12939799be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1528550810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de686fb-f9a7-4e42-869f-2229908e525e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ac05df63c407fad754826d52fb0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:58Z,use_quota=True,user_id='021176d66f024aaf92b236d79a879f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ead4752-de59-46db-914e-f1ab6ddc6bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ead4752-de59-46db-914e-f1ab6ddc6bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d308d-937a-48e2-8a91-a484ab3c6d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d308d-937a-48e2-8a91-a484ab3c6d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de686fb-f9a7-4e42-869f-2229908e525e', 'volume_name': 'volume-4de686fb-f9a7-4e42-869f-2229908e525e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108ded52-3228-4a43-8266-e2d4ad89738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108ded52-3228-4a43-8266-e2d4ad89738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001ec5db-9a46-4208-a876-006b104d46a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Volume 4de686fb-f9a7-4e42-869f-2229908e525e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de686fb-f9a7-4e42-869f-2229908e525e', 'volume_size': 1} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:58 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 1073741824" returned: 0 in 0.837s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:58 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 Apr 29 09:12:58 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:59 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1" returned: 0 in 0.610s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1528550810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de686fb-f9a7-4e42-869f-2229908e525e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ac05df63c407fad754826d52fb0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:58Z,use_quota=True,user_id='021176d66f024aaf92b236d79a879f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Creating volume 4de686fb-f9a7-4e42-869f-2229908e525e {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:12:59 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82022921-e5d2-4d62-b1d8-de6e9b483d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604cbf84-746e-489f-975d-85e49adaf2b1', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:59 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e 1073741824 Apr 29 09:12:59 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b797132d-8923-4303-9d0c-0dd196c7a5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:12:59 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Volume volume-604cbf84-746e-489f-975d-85e49adaf2b1 (604cbf84-746e-489f-975d-85e49adaf2b1): created successfully Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b797132d-8923-4303-9d0c-0dd196c7a5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:12:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (e91b78d1-7d5a-4e6b-852c-183125f31a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:12:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8827851b-e5eb-4134-817a-2e4d61a5df61 tempest-VolumesGetTest-985433763 None] Created volume successfully. Apr 29 09:13:00 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e 1073741824" returned: 0 in 0.800s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=109,cinder:SELECT=96,cinder:INSERT=29,cinder:DELETE=11 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:00 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e Apr 29 09:13:00 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:00 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (9b25ab44-79c4-4ce1-8388-d359aca3cf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944580f7-b4c3-4d3f-b294-c0aac9735d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e" returned: 0 in 0.689s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.454s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944580f7-b4c3-4d3f-b294-c0aac9735d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-424379971',display_name='tempest-VolumesGetTest-Volume-327575453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e16dc9-3d1d-4a7b-9201-fb489c73dfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:01Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ecc3a4-1a5c-4acd-8e47-4b3ef4b261e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ecc3a4-1a5c-4acd-8e47-4b3ef4b261e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:00 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a291798-3a65-4d27-8244-d8149ee626a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a291798-3a65-4d27-8244-d8149ee626a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e16dc9-3d1d-4a7b-9201-fb489c73dfe4', 'volume_name': 'volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cbab01-97cd-48c1-94c0-458c3e68b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cbab01-97cd-48c1-94c0-458c3e68b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efa0654-a9cd-4455-bac0-54fbe8b25967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:01 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Volume 99e16dc9-3d1d-4a7b-9201-fb489c73dfe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4', 'volume_size': 1} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Creating offline snapshot 0cd98e32-ead2-4a7d-bb45-6f3e315957c9 of volume aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001ec5db-9a46-4208-a876-006b104d46a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de686fb-f9a7-4e42-869f-2229908e525e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668fb457-23ba-4683-8f91-a93cc493a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac02716-a49b-4dc2-869f-dd4e80948c5c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:01 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Volume volume-4de686fb-f9a7-4e42-869f-2229908e525e (4de686fb-f9a7-4e42-869f-2229908e525e): created successfully Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668fb457-23ba-4683-8f91-a93cc493a573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Flow 'volume_create_manager' (8733aa1e-9a6f-4a85-8df8-ab958f46159c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3e8d2a8f-ce88-4c8d-b8d0-d8a5cfec7b42 tempest-VolumesTransfersTest-1728850282 None] Created volume successfully. Apr 29 09:13:01 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 Apr 29 09:13:01 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:01 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" returned: 0 in 0.739s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:01 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 1G Apr 29 09:13:01 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1a3e919d-8290-4f1b-9f51-50e6c1aaefec tempest-VolumesTransfersTest-1819887576 None] Transfer volume completed successfully. Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:02 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 1G" returned: 0 in 0.748s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:02 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:02 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:02 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 Apr 29 09:13:02 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Acquiring lock "cinder-4de686fb-f9a7-4e42-869f-2229908e525e-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Lock "cinder-4de686fb-f9a7-4e42-869f-2229908e525e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=104,cinder:INSERT=28,cinder:UPDATE=131,cinder:DELETE=11 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Acquiring lock "cinder-quobyte-4de686fb-f9a7-4e42-869f-2229908e525e" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Lock "cinder-quobyte-4de686fb-f9a7-4e42-869f-2229908e525e" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d045ed24-6c8a-40b7-9f11-9a6c2667932a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:03 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e Apr 29 09:13:03 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:03 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.608s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:03 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9" returned: 0 in 0.671s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:03 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 is being set with open permissions: ugo+rw Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:03 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 Apr 29 09:13:03 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:03 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e" returned: 0 in 0.734s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:03 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e Apr 29 09:13:03 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:03 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9" returned: 0 in 0.597s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:03 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.info Apr 29 09:13:03 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:04 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-4de686fb-f9a7-4e42-869f-2229908e525e" returned: 0 in 0.577s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Lock "cinder-quobyte-4de686fb-f9a7-4e42-869f-2229908e525e" released by "delete_volume" :: held 1.365s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Created reservations ['3fa4f883-5dfe-49f9-905f-1bdbc656c3e9', '4cf668bf-31bb-4a37-845d-62d5db6de40c', '7a80740a-4ada-48ea-87b2-069774f5def2', '8d00c081-9993-4969-a92e-f0c722306803'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:04 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:04 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:04 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.info" returned: 0 in 0.616s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:04 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.info is being set with open permissions: ugo+rw Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:04 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.info Apr 29 09:13:04 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:04 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.596s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:04 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Deleted volume successfully. Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-059bf99f-4e1e-4fb5-b7f4-0d13be3ad30b tempest-VolumesTransfersTest-646692116 None] Lock "cinder-4de686fb-f9a7-4e42-869f-2229908e525e-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:05 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.info" returned: 0 in 0.576s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.087s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.048s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-424379971',display_name='tempest-VolumesGetTest-Volume-327575453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e16dc9-3d1d-4a7b-9201-fb489c73dfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:01Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Creating volume 99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:05 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:05 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 1073741824 Apr 29 09:13:05 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4bdb0973-c646-4156-a271-afc311b3832d tempest-VolumesSnapshotTestJSON-1523715725 None] Create snapshot completed successfully Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Flow 'volume_create_manager' (2355eaed-2238-43b8-8d23-901dc85ac8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109b253d-4c00-45a3-ba72-e323fccd227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109b253d-4c00-45a3-ba72-e323fccd227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-721995774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd082794-2028-4343-865b-fa4ac1e08378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ac05df63c407fad754826d52fb0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:06Z,use_quota=True,user_id='021176d66f024aaf92b236d79a879f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2347900-78d2-4570-bb72-9da37c55fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2347900-78d2-4570-bb72-9da37c55fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c6cfe-ef9a-4b63-9ee7-d593cef681d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c6cfe-ef9a-4b63-9ee7-d593cef681d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd082794-2028-4343-865b-fa4ac1e08378', 'volume_name': 'volume-cd082794-2028-4343-865b-fa4ac1e08378', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595b0641-0232-411c-8352-2bb15b277ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595b0641-0232-411c-8352-2bb15b277ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8f0dad-69d0-4503-a2a7-4039086a925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:05 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Volume cd082794-2028-4343-865b-fa4ac1e08378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd082794-2028-4343-865b-fa4ac1e08378', 'volume_size': 1} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:05 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 1073741824" returned: 0 in 0.809s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:05 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 Apr 29 09:13:05 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (e620eaaa-11d7-4ee4-8cbc-7a1f2b195392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd61e484-4b85-4b69-adf2-59824e392542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd61e484-4b85-4b69-adf2-59824e392542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-733442018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be48ce9-c759-41db-871d-26a784b6269f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11457b81362849298197caf7e979552f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0cd98e32-ead2-4a7d-bb45-6f3e315957c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:06Z,use_quota=True,user_id='f892a647aab440f7a51c70a2ec933f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81168529-d7a0-459e-8ce1-fb4325b259b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81168529-d7a0-459e-8ce1-fb4325b259b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97729777-092e-453b-ba02-3d9bcc9e6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97729777-092e-453b-ba02-3d9bcc9e6a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0be48ce9-c759-41db-871d-26a784b6269f', 'volume_name': 'volume-0be48ce9-c759-41db-871d-26a784b6269f', 'volume_size': 1, 'snapshot_id': '0cd98e32-ead2-4a7d-bb45-6f3e315957c9'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44683eb-384e-4d55-9856-718d33873dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44683eb-384e-4d55-9856-718d33873dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d87561a-3795-444e-b53e-4757812b84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:06 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Volume 0be48ce9-c759-41db-871d-26a784b6269f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0be48ce9-c759-41db-871d-26a784b6269f', 'volume_size': 1, 'snapshot_id': '0cd98e32-ead2-4a7d-bb45-6f3e315957c9'} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:06 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-721995774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd082794-2028-4343-865b-fa4ac1e08378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ac05df63c407fad754826d52fb0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:06Z,use_quota=True,user_id='021176d66f024aaf92b236d79a879f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Creating volume cd082794-2028-4343-865b-fa4ac1e08378 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:06 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efa0654-a9cd-4455-bac0-54fbe8b25967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f17a06-2e44-44ed-9500-34bcf8228d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:06 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 1073741824 Apr 29 09:13:06 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:06 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Volume volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 (99e16dc9-3d1d-4a7b-9201-fb489c73dfe4): created successfully Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f17a06-2e44-44ed-9500-34bcf8228d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (9b25ab44-79c4-4ce1-8388-d359aca3cf76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5b8995d4-50ff-4b07-b9fe-1cd50d61faf6 tempest-VolumesGetTest-985433763 None] Created volume successfully. Apr 29 09:13:07 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 1073741824" returned: 0 in 0.822s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Lock "cinder-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:07 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 Apr 29 09:13:07 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[510e3326-496f-4d8a-9ce9-1ce6599800f6]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:07 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 Apr 29 09:13:07 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:08 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378" returned: 0 in 0.583s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.727s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-0cd98e32-ead2-4a7d-bb45-6f3e315957c9-0be48ce9-c759-41db-871d-26a784b6269f" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8f0dad-69d0-4503-a2a7-4039086a925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd082794-2028-4343-865b-fa4ac1e08378', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93751e9d-f1d4-40dd-9ece-1f9dbe3da645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0cd98e32-ead2-4a7d-bb45-6f3e315957c9-0be48ce9-c759-41db-871d-26a784b6269f" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Creating volume 0be48ce9-c759-41db-871d-26a784b6269f from snapshot 0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-0be48ce9-c759-41db-871d-26a784b6269f" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:08 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Volume volume-cd082794-2028-4343-865b-fa4ac1e08378 (cd082794-2028-4343-865b-fa4ac1e08378): created successfully Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93751e9d-f1d4-40dd-9ece-1f9dbe3da645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Flow 'volume_create_manager' (2355eaed-2238-43b8-8d23-901dc85ac8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0be48ce9-c759-41db-871d-26a784b6269f" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] snapshot: 0cd98e32-ead2-4a7d-bb45-6f3e315957c9, volume: 0be48ce9-c759-41db-871d-26a784b6269f, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:13:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7ad40d7d-8ba2-46ac-a417-fb803002bbbb tempest-VolumesTransfersTest-1728850282 None] Created volume successfully. Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[756e0536-572f-446e-b47e-87b3a7d1b602]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:08 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4" returned: 0 in 0.743s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:08 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 Apr 29 09:13:08 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:08 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4 Apr 29 09:13:08 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:08 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4" returned: 0 in 0.596s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4" released by "delete_volume" :: held 1.395s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:08 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9" returned: 0 in 0.764s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Created reservations ['1b11460a-1875-404c-a58f-a27a24f7588d', 'c982355b-4794-40b7-a91e-c4f55cac896d', 'dbc34f19-41c3-4636-b068-71d8dfe5aafd', 'f33f732f-9743-4eee-9690-bc200b04d222'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2f187-9c92-4ce8-b900-71a2a5da82b2]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Acquiring lock "cinder-cd082794-2028-4343-865b-fa4ac1e08378-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:09 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 Apr 29 09:13:09 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Lock "cinder-cd082794-2028-4343-865b-fa4ac1e08378-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:09 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:09 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Acquiring lock "cinder-quobyte-cd082794-2028-4343-865b-fa4ac1e08378" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Lock "cinder-quobyte-cd082794-2028-4343-865b-fa4ac1e08378" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6208dad4-a8d3-480e-bb54-aa88df2fc0de]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:09 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 Apr 29 09:13:09 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:09 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" returned: 0 in 0.760s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:09 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-604cbf84-746e-489f-975d-85e49adaf2b1-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.690s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:09 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f Apr 29 09:13:09 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:09 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Deleted volume successfully. Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Lock "cinder-604cbf84-746e-489f-975d-85e49adaf2b1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4eed24d3-3c6b-450d-a054-0fcaef6704a9 tempest-VolumesGetTest-985433763 None] Lock "cinder-99e16dc9-3d1d-4a7b-9201-fb489c73dfe4-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-604cbf84-746e-489f-975d-85e49adaf2b1" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-604cbf84-746e-489f-975d-85e49adaf2b1" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b59f917-c727-470e-ae2c-bcd9cdb47334]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:09 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378" returned: 0 in 0.767s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:10 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378 Apr 29 09:13:10 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:10 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 Apr 29 09:13:10 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:10 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cd082794-2028-4343-865b-fa4ac1e08378" returned: 0 in 0.678s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Lock "cinder-quobyte-cd082794-2028-4343-865b-fa4ac1e08378" released by "delete_volume" :: held 1.516s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Created reservations ['a044427c-cb82-48a5-a0de-974b722110c5', '2f237393-6414-480e-9c99-eccabe5dc1fe', '0aeea0ee-8c13-4c55-bae3-f0fa9e4b1fc0', 'bf42a380-c0cf-4764-a8de-9292d7a7e65f'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:11 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:11 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:11 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1" returned: 0 in 1.307s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:11 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1 Apr 29 09:13:11 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:11 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.989s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:11 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:11 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Deleted volume successfully. Apr 29 09:13:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c4d29c25-fd71-4f2d-abbd-bb465a1990cf tempest-VolumesTransfersTest-646692116 None] Lock "cinder-cd082794-2028-4343-865b-fa4ac1e08378-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:12 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-604cbf84-746e-489f-975d-85e49adaf2b1" returned: 0 in 1.518s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-604cbf84-746e-489f-975d-85e49adaf2b1" released by "delete_volume" :: held 2.883s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:12 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Created reservations ['76b5e062-f3ac-4743-a266-60a47a079673', '6a280c57-37f5-45e5-b758-ad50ce08503f', '47a70628-9778-4db5-b1ba-6459451b8510', '44a4b76d-d16e-4ce9-acc1-4aba0b5d6f0c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:13 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:13 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (ab03065a-e33e-4a20-b65e-8b4606ca1403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679e1a74-d4e3-454a-874e-58f10c5f4015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679e1a74-d4e3-454a-874e-58f10c5f4015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1296578337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad114885-6e88-4651-8296-4c11313d8136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:14Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815eb0ab-16c1-4535-b888-8277337cd2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815eb0ab-16c1-4535-b888-8277337cd2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1702ba45-416f-4322-b0c1-497e9610426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1702ba45-416f-4322-b0c1-497e9610426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad114885-6e88-4651-8296-4c11313d8136', 'volume_name': 'volume-ad114885-6e88-4651-8296-4c11313d8136', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79606e-683e-48aa-9567-683b77447ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79606e-683e-48aa-9567-683b77447ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfc5b5f-e1d1-4f56-b652-cb91378c6b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:14 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Volume ad114885-6e88-4651-8296-4c11313d8136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad114885-6e88-4651-8296-4c11313d8136', 'volume_size': 1} Apr 29 09:13:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:15 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 2.318s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:15 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:15 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Deleted volume successfully. Apr 29 09:13:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08b4caaa-10de-42a9-9423-88f2bcffc515 tempest-VolumesGetTest-985433763 None] Lock "cinder-604cbf84-746e-489f-975d-85e49adaf2b1-delete_volume" released by "delete_volume" :: held 5.779s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:15 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f" returned: 0 in 5.970s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:15 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac92a6a-62f0-496f-ac11-5ea4c0868308]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:15 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 Apr 29 09:13:15 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:16 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" returned: 0 in 0.926s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:16 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:13:16 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Converted 1024.00 MB image at 171.50 MB/s Apr 29 09:13:16 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f is being set with open permissions: ugo+rw Apr 29 09:13:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:16 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f Apr 29 09:13:16 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:17 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f" returned: 0 in 0.665s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0be48ce9-c759-41db-871d-26a784b6269f" released by "_copy_volume_from_snapshot" :: held 9.196s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0cd98e32-ead2-4a7d-bb45-6f3e315957c9-0be48ce9-c759-41db-871d-26a784b6269f" released by "_create_volume_from_snapshot" :: held 9.254s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.294s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.669s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1296578337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad114885-6e88-4651-8296-4c11313d8136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:14Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Creating volume ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:17 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:17 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 1073741824 Apr 29 09:13:17 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d87561a-3795-444e-b53e-4757812b84d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be48ce9-c759-41db-871d-26a784b6269f', 'volume_size': 1, 'snapshot_id': '0cd98e32-ead2-4a7d-bb45-6f3e315957c9'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c6a2cd-f6c5-47a9-a7c7-1c7e28b94347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:17 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Volume volume-0be48ce9-c759-41db-871d-26a784b6269f (0be48ce9-c759-41db-871d-26a784b6269f): created successfully Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c6a2cd-f6c5-47a9-a7c7-1c7e28b94347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Flow 'volume_create_manager' (e620eaaa-11d7-4ee4-8cbc-7a1f2b195392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7d1e66b3-58db-4b7b-99b6-712a834e600a tempest-VolumesSnapshotTestJSON-1523715725 None] Created volume successfully. Apr 29 09:13:18 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 1073741824" returned: 0 in 0.897s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:18 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 Apr 29 09:13:18 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-0be48ce9-c759-41db-871d-26a784b6269f-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-0be48ce9-c759-41db-871d-26a784b6269f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-0be48ce9-c759-41db-871d-26a784b6269f" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0be48ce9-c759-41db-871d-26a784b6269f" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aae66d-85eb-4ec9-9156-5b43b0e5183d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:18 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f Apr 29 09:13:18 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:18 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136" returned: 0 in 0.651s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfc5b5f-e1d1-4f56-b652-cb91378c6b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad114885-6e88-4651-8296-4c11313d8136', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ad0e79-a5d1-49b2-a4bb-dd78cd8e4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:19 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Volume volume-ad114885-6e88-4651-8296-4c11313d8136 (ad114885-6e88-4651-8296-4c11313d8136): created successfully Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ad0e79-a5d1-49b2-a4bb-dd78cd8e4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (ab03065a-e33e-4a20-b65e-8b4606ca1403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:19 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1ba1db83-18f0-494a-97ed-30dc47036856 tempest-VolumesGetTest-985433763 None] Created volume successfully. Apr 29 09:13:19 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f" returned: 0 in 0.742s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:19 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f Apr 29 09:13:19 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Flow 'volume_create_manager' (482d4df6-667e-4ffd-a4ab-99661b296787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc5f27-412b-437f-815a-25835b8186eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc5f27-412b-437f-815a-25835b8186eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1674295054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e08afe76-518d-4ebb-a220-57ed06a34915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593a1f6ba9548bf87997845360721f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:20Z,use_quota=True,user_id='77f8bb64d04649bdb7a1f8e4b51c7c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f36db0-dd82-49e2-8dfb-b5bf8529ef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f36db0-dd82-49e2-8dfb-b5bf8529ef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5803b9b-f058-4103-804f-0cfa45349545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5803b9b-f058-4103-804f-0cfa45349545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e08afe76-518d-4ebb-a220-57ed06a34915', 'volume_name': 'volume-e08afe76-518d-4ebb-a220-57ed06a34915', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286c8c72-c625-4db7-aa59-0d7c8ad87fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286c8c72-c625-4db7-aa59-0d7c8ad87fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d465fd9-8757-4ce6-a45e-feabbc858f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:19 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Volume e08afe76-518d-4ebb-a220-57ed06a34915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e08afe76-518d-4ebb-a220-57ed06a34915', 'volume_size': 1} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1674295054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e08afe76-518d-4ebb-a220-57ed06a34915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593a1f6ba9548bf87997845360721f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:20Z,use_quota=True,user_id='77f8bb64d04649bdb7a1f8e4b51c7c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Creating volume e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:19 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:19 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 1073741824 Apr 29 09:13:19 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:20 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0be48ce9-c759-41db-871d-26a784b6269f" returned: 0 in 0.649s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0be48ce9-c759-41db-871d-26a784b6269f" released by "delete_volume" :: held 1.454s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['d82a1967-8d29-4c39-95c5-493a7c9b10c9', '6b179c08-86af-43c8-baa8-66765a22a0fb', '1bb630ef-bc3a-4e03-9171-e3133cc2ae5d', '0d6bfb91-5d38-43e1-a72a-847a75137f32'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:20 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:20 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (8e833d5b-40c1-4bdb-b4eb-6c1b31ef4f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646965c5-f81f-4cf2-bd7f-8ae896b4b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646965c5-f81f-4cf2-bd7f-8ae896b4b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-849878936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ad114885-6e88-4651-8296-4c11313d8136,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:20Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302c2611-a011-4733-80da-c696fe54a5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302c2611-a011-4733-80da-c696fe54a5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f71f86-c715-48e3-ac53-680b39ae286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f71f86-c715-48e3-ac53-680b39ae286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3', 'volume_name': 'volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3', 'volume_size': 1, 'source_volid': 'ad114885-6e88-4651-8296-4c11313d8136', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef75c1-7083-4816-8a25-72824f3297f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef75c1-7083-4816-8a25-72824f3297f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34f1684-ed9d-4643-8b23-9eeb692899db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:20 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Volume 3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3', 'volume_size': 1, 'source_volid': 'ad114885-6e88-4651-8296-4c11313d8136', 'source_volstatus': 'available'} Apr 29 09:13:20 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 1073741824" returned: 0 in 0.891s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:20 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 Apr 29 09:13:20 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-0cd98e32-ead2-4a7d-bb45-6f3e315957c9-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-0cd98e32-ead2-4a7d-bb45-6f3e315957c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:20 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.624s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-0cd98e32-ead2-4a7d-bb45-6f3e315957c9" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Deleted volume successfully. Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0cd98e32-ead2-4a7d-bb45-6f3e315957c9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Deleting offline snapshot 0cd98e32-ead2-4a7d-bb45-6f3e315957c9 of volume aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] snapshot_file for this snap is: volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-bcfe56a8-22a8-4d63-bb28-48c4a97bf6f7 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-0be48ce9-c759-41db-871d-26a784b6269f-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1f174c-02dc-4b26-818c-a2455b8f8b18]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:21 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 Apr 29 09:13:21 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:21 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915" returned: 0 in 0.692s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.731s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:21 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Cloning volume ad114885-6e88-4651-8296-4c11313d8136 to volume 3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d465fd9-8757-4ce6-a45e-feabbc858f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e08afe76-518d-4ebb-a220-57ed06a34915', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcb409e-efe7-4553-919b-d90f2229823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:21 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Volume volume-e08afe76-518d-4ebb-a220-57ed06a34915 (e08afe76-518d-4ebb-a220-57ed06a34915): created successfully Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcb409e-efe7-4553-919b-d90f2229823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Flow 'volume_create_manager' (482d4df6-667e-4ffd-a4ab-99661b296787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:21 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d4c103a3-f6bb-4235-9e08-34a99a0de507 tempest-VolumesCloneTest-1227724045 None] Created volume successfully. Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Creating offline snapshot a9d72196-5980-49c3-b8da-964ae8c3aaef of volume ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[55127a53-6699-47a9-b175-d12c0024ed89]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:21 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 Apr 29 09:13:21 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:21 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9" returned: 0 in 0.732s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a6d5dd-c29d-4bda-ab7f-c950d4aecfb7]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:21 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 Apr 29 09:13:21 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:22 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136" returned: 0 in 0.737s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:22 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef 1G Apr 29 09:13:22 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Flow 'volume_create_manager' (8915d2da-5e80-4925-b876-5c4ae04b96e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e13d575-a4d0-4368-82e6-0c5149599bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e13d575-a4d0-4368-82e6-0c5149599bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1863261927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0770b79a-50f8-488d-8d53-bd412036e875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593a1f6ba9548bf87997845360721f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e08afe76-518d-4ebb-a220-57ed06a34915,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:22Z,use_quota=True,user_id='77f8bb64d04649bdb7a1f8e4b51c7c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70634a6-b9bf-490d-86b8-460a61752e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70634a6-b9bf-490d-86b8-460a61752e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057b8636-714b-477b-a392-9a69f00a8ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057b8636-714b-477b-a392-9a69f00a8ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0770b79a-50f8-488d-8d53-bd412036e875', 'volume_name': 'volume-0770b79a-50f8-488d-8d53-bd412036e875', 'volume_size': 2, 'source_volid': 'e08afe76-518d-4ebb-a220-57ed06a34915', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c361420-b229-4ecc-9730-6219391dae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c361420-b229-4ecc-9730-6219391dae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356fed53-6d7a-4e7c-8ed4-04970aa4935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:22 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Volume 0770b79a-50f8-488d-8d53-bd412036e875: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0770b79a-50f8-488d-8d53-bd412036e875', 'volume_size': 2, 'source_volid': 'e08afe76-518d-4ebb-a220-57ed06a34915', 'source_volstatus': 'available'} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:22 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" returned: 0 in 0.790s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:22 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 Apr 29 09:13:22 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:22 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef 1G" returned: 0 in 0.758s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad114885-6e88-4651-8296-4c11313d8136 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:23 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad114885-6e88-4651-8296-4c11313d8136 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef Apr 29 09:13:23 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:23 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9" returned: 0 in 0.691s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:23 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9 Apr 29 09:13:23 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:23 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad114885-6e88-4651-8296-4c11313d8136 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef" returned: 0 in 0.658s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:23 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef is being set with open permissions: ugo+rw Apr 29 09:13:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:23 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef Apr 29 09:13:23 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:23 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339.0cd98e32-ead2-4a7d-bb45-6f3e315957c9" returned: 0 in 0.614s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-0cd98e32-ead2-4a7d-bb45-6f3e315957c9" released by "_delete_snapshot" :: held 2.949s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" released by "delete_snapshot" :: held 2.992s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['aad57209-a919-4292-9f0e-de1f687dded2', '1ab8b049-e605-4b17-aec2-186f5f1cab80', '3e881212-fbee-46ea-85dc-173f8c281da6', 'd7ca2cc4-9c64-4452-acb3-9a0b2e28f41b'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:24 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Delete snapshot completed successfully. Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8cfc9d22-c3a6-44c8-a7ba-1c38f283b7b6 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-0cd98e32-ead2-4a7d-bb45-6f3e315957c9-delete_snapshot" released by "delete_snapshot" :: held 3.148s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:24 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef" returned: 0 in 0.628s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[2994ee66-5cba-45cf-a7be-deaadc1b6b75]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:24 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.info Apr 29 09:13:24 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:24 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 Apr 29 09:13:24 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:24 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.info" returned: 0 in 0.590s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:24 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.info is being set with open permissions: ugo+rw Apr 29 09:13:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:24 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.info Apr 29 09:13:24 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:25 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" returned: 0 in 0.730s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:25 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339 Apr 29 09:13:25 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:25 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.info" returned: 0 in 0.599s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] snapshot: a9d72196-5980-49c3-b8da-964ae8c3aaef, volume: 3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff3bdc-63d0-4330-8a79-bec0abc52436]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:25 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" returned: 0 in 0.631s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339" released by "delete_volume" :: held 1.428s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:25 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef Apr 29 09:13:25 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['25867291-a533-4209-837d-4d7ab9c2879c', '9035ce55-5b19-44c1-9835-1a762a595944', '1a40f6fc-fdab-42b0-a792-9df1cbb3ddb1', '481ea0fa-7718-442d-a01d-f6d7296b261c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:25 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:25 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:26 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef" returned: 0 in 0.691s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad114885-6e88-4651-8296-4c11313d8136(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[471bacc9-7ca2-4b2a-af51-6f30b15bc4c5]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:26 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 Apr 29 09:13:26 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:26 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.663s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Deleted volume successfully. Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-66ffc734-f2c7-4311-99a9-f6a184672a89-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3830456b-8f5e-492e-bfaf-34ea0082f091 tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-aa45a8be-ca6b-4fbf-93ed-2ec37dce3339-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-66ffc734-f2c7-4311-99a9-f6a184672a89-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "cinder-quobyte-66ffc734-f2c7-4311-99a9-f6a184672a89" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-66ffc734-f2c7-4311-99a9-f6a184672a89" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c63eb2-3453-4194-9a8a-f7234ce102ff]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:26 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 Apr 29 09:13:26 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:27 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136" returned: 0 in 0.731s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:27 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:13:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:27 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 Apr 29 09:13:27 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:27 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89" returned: 0 in 0.705s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:27 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89 Apr 29 09:13:27 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:28 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-66ffc734-f2c7-4311-99a9-f6a184672a89" returned: 0 in 0.724s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-quobyte-66ffc734-f2c7-4311-99a9-f6a184672a89" released by "delete_volume" :: held 1.517s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Created reservations ['096d9f69-ebea-4788-8421-049b2362ec2e', '9837181d-e911-4a6b-be9b-3c688c4d8733', 'dce3abd0-bb98-4ec0-adde-6a27f5190569', '48c4209a-050d-46de-89bc-62388e21869c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:28 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:28 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:30 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.535s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:30 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:30 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Deleted volume successfully. Apr 29 09:13:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-708ac381-0e9c-4ca1-b656-65df4d75602f tempest-VolumesSnapshotTestJSON-1523715725 None] Lock "cinder-66ffc734-f2c7-4311-99a9-f6a184672a89-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:32 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" returned: 0 in 5.262s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:32 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002cb0a-9d91-470e-b9a1-bd743cefbc89]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:32 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 Apr 29 09:13:32 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:33 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136" returned: 0 in 0.876s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:13:33 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Converted 1024.00 MB image at 194.57 MB/s Apr 29 09:13:33 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 is being set with open permissions: ugo+rw Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:33 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 Apr 29 09:13:33 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:33 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" returned: 0 in 0.632s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" released by "_copy_volume_from_snapshot" :: held 8.274s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-a9d72196-5980-49c3-b8da-964ae8c3aaef" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-a9d72196-5980-49c3-b8da-964ae8c3aaef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Deleting offline snapshot a9d72196-5980-49c3-b8da-964ae8c3aaef of volume ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] snapshot_file for this snap is: volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[454a8f0b-56d0-4527-bc3f-b47944c26cc1]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:34 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef Apr 29 09:13:34 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:34 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef" returned: 0 in 0.749s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad114885-6e88-4651-8296-4c11313d8136(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:13:34 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9567c335-0c81-4543-83af-3b2ae7007679]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:34 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 Apr 29 09:13:34 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:35 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136" returned: 0 in 0.718s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:35 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef Apr 29 09:13:35 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:36 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef" returned: 0 in 0.741s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:36 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef Apr 29 09:13:36 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (b40a1fa5-7b7e-4eb4-a18f-6a48fc045605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182a0aee-c177-4f3b-81b6-29e097ee6f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182a0aee-c177-4f3b-81b6-29e097ee6f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495884842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e2238f-517e-4333-870f-5d97293275f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:36Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e50018-aff0-4c62-9772-376c56601826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e50018-aff0-4c62-9772-376c56601826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ccdf9e-dfaf-4c15-9e53-5499e925455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ccdf9e-dfaf-4c15-9e53-5499e925455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e2238f-517e-4333-870f-5d97293275f3', 'volume_name': 'volume-40e2238f-517e-4333-870f-5d97293275f3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05f91f9-7759-440c-b7b1-a011265094aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05f91f9-7759-440c-b7b1-a011265094aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a06e566-118d-4853-a8bf-ced053b20dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Volume 40e2238f-517e-4333-870f-5d97293275f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e2238f-517e-4333-870f-5d97293275f3', 'volume_size': 1} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (79e118d4-b094-42c4-8a7a-587e20e654e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92063760-8ad4-402b-85b0-0baf59c5ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92063760-8ad4-402b-85b0-0baf59c5ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1458814528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7fd06c-dc63-4585-94ad-3a4230f08083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:37Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce7461-2306-48d5-a87e-d4f47b7ecbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce7461-2306-48d5-a87e-d4f47b7ecbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11bcbc2-b68f-4c0f-8290-e3000cd4460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11bcbc2-b68f-4c0f-8290-e3000cd4460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7fd06c-dc63-4585-94ad-3a4230f08083', 'volume_name': 'volume-db7fd06c-dc63-4585-94ad-3a4230f08083', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3490d6fa-317e-431f-aecb-7ea7e8b5c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3490d6fa-317e-431f-aecb-7ea7e8b5c39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25220b57-af15-45e0-abe7-e14f416fc9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Volume db7fd06c-dc63-4585-94ad-3a4230f08083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7fd06c-dc63-4585-94ad-3a4230f08083', 'volume_size': 1} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:36 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136.a9d72196-5980-49c3-b8da-964ae8c3aaef" returned: 0 in 0.627s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-a9d72196-5980-49c3-b8da-964ae8c3aaef" released by "_delete_snapshot" :: held 2.937s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.500s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 14.465s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:36 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Cloning volume e08afe76-518d-4ebb-a220-57ed06a34915 to volume 0770b79a-50f8-488d-8d53-bd412036e875 Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (53e6ca54-f9d8-4a3f-8ea6-67ec88e4e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f5bb42-73b8-4cd2-a44c-d9a6ff6bb4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34f1684-ed9d-4643-8b23-9eeb692899db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3', 'volume_size': 1, 'source_volid': 'ad114885-6e88-4651-8296-4c11313d8136', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e17a99-4ff9-45cf-b720-4af67c4cc1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f5bb42-73b8-4cd2-a44c-d9a6ff6bb4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-92819896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ff8490-2bd6-41e6-8809-ad4165d01488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:37Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8b2a2d-f28e-42ef-b203-f066033cf37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8b2a2d-f28e-42ef-b203-f066033cf37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996209d3-64b2-4d9f-9191-6fd16192ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996209d3-64b2-4d9f-9191-6fd16192ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ff8490-2bd6-41e6-8809-ad4165d01488', 'volume_name': 'volume-46ff8490-2bd6-41e6-8809-ad4165d01488', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0266a78d-6753-4ee6-b1bc-989ef04649e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0266a78d-6753-4ee6-b1bc-989ef04649e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fce4019-d1e8-49fa-873b-19f32e906521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Volume 46ff8490-2bd6-41e6-8809-ad4165d01488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ff8490-2bd6-41e6-8809-ad4165d01488', 'volume_size': 1} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:37 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Volume volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 (3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3): created successfully Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e17a99-4ff9-45cf-b720-4af67c4cc1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (8e833d5b-40c1-4bdb-b4eb-6c1b31ef4f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Creating offline snapshot 538c9b4c-5587-4c85-bb0b-1acd41c73bc6 of volume e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f41059-2b50-4ca1-8e0f-d90b00c74414]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e5932e11-eb6f-4e5b-ad86-5aacbd169e8c tempest-VolumesGetTest-985433763 None] Created volume successfully. Apr 29 09:13:37 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 Apr 29 09:13:37 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (f0f63bae-7cca-41bb-b97a-aef794e328e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c2aa1-ee57-45af-b819-cc3a8cf206ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c2aa1-ee57-45af-b819-cc3a8cf206ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497748471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97af0021-e74b-478d-a9a9-170836c6b0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:37Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b21fec8-b0b1-4b03-9654-c9f504ec2240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b21fec8-b0b1-4b03-9654-c9f504ec2240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57da6461-f810-472d-a78d-d45f551370f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57da6461-f810-472d-a78d-d45f551370f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97af0021-e74b-478d-a9a9-170836c6b0f0', 'volume_name': 'volume-97af0021-e74b-478d-a9a9-170836c6b0f0', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d90527a-b6f7-459d-bebf-a94e443cbf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d90527a-b6f7-459d-bebf-a94e443cbf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffbe53d-f856-4746-9b67-c0fa576369c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Volume 97af0021-e74b-478d-a9a9-170836c6b0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97af0021-e74b-478d-a9a9-170836c6b0f0', 'volume_size': 1} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (c11ac8a8-05cb-49d3-b662-67a7a8c1a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb8b3e1-06fc-4465-88fd-b948e0acc128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb8b3e1-06fc-4465-88fd-b948e0acc128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968991095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f3b77e-c5ab-4425-a0a6-7284ba501458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:38Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c82cde0-2cfb-486c-a126-1e1dd7eec498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c82cde0-2cfb-486c-a126-1e1dd7eec498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b58d9b9-7f51-45f0-8e48-5fea83cd0bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b58d9b9-7f51-45f0-8e48-5fea83cd0bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f3b77e-c5ab-4425-a0a6-7284ba501458', 'volume_name': 'volume-74f3b77e-c5ab-4425-a0a6-7284ba501458', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540c30b0-b012-4366-a004-a64290be2832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540c30b0-b012-4366-a004-a64290be2832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb1f457-94cd-46f7-9ee3-13ee09c2fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:37 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Volume 74f3b77e-c5ab-4425-a0a6-7284ba501458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f3b77e-c5ab-4425-a0a6-7284ba501458', 'volume_size': 1} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:37 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915" returned: 0 in 0.712s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:37 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 1G Apr 29 09:13:37 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:38 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 1G" returned: 0 in 0.721s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e08afe76-518d-4ebb-a220-57ed06a34915 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:38 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e08afe76-518d-4ebb-a220-57ed06a34915 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 Apr 29 09:13:38 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (b3ba34d4-e9af-4f61-b635-12e16b1f050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312cb0bd-0bc7-42c3-8bff-a52ba4a90169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312cb0bd-0bc7-42c3-8bff-a52ba4a90169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1628586809',display_name='tempest-VolumesGetTest-Volume-117802889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e7a5e3-28a4-4329-b6e4-aaa9f4d091db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:39Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b467b78-9acd-479c-abb9-42755f1f0e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b467b78-9acd-479c-abb9-42755f1f0e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24ad82f-bca9-455c-9e61-be4d48e34cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24ad82f-bca9-455c-9e61-be4d48e34cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e7a5e3-28a4-4329-b6e4-aaa9f4d091db', 'volume_name': 'volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8132171a-0425-413f-97a6-b873af1e4a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8132171a-0425-413f-97a6-b873af1e4a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c714dc-186d-44fd-b69a-a8c53844b03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:38 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Volume 13e7a5e3-28a4-4329-b6e4-aaa9f4d091db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db', 'volume_size': 1} Apr 29 09:13:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:39 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e08afe76-518d-4ebb-a220-57ed06a34915 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6" returned: 0 in 0.662s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:39 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 is being set with open permissions: ugo+rw Apr 29 09:13:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:39 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 Apr 29 09:13:39 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:39 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6" returned: 0 in 0.556s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:39 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.info Apr 29 09:13:39 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:40 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.info" returned: 0 in 0.566s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:40 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.info is being set with open permissions: ugo+rw Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:40 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.info Apr 29 09:13:40 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:40 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.info" returned: 0 in 0.563s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Acquiring lock "cinder-quobyte-0770b79a-50f8-488d-8d53-bd412036e875" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-0770b79a-50f8-488d-8d53-bd412036e875" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] snapshot: 538c9b4c-5587-4c85-bb0b-1acd41c73bc6, volume: 0770b79a-50f8-488d-8d53-bd412036e875, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af1157-505b-4719-89db-ef058e8e2d7c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:41 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 Apr 29 09:13:41 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:41 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6" returned: 0 in 0.664s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e08afe76-518d-4ebb-a220-57ed06a34915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:13:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:13:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:13:41 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[503804f7-3215-4cf5-936e-319a38d51b7b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:41 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 Apr 29 09:13:41 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:42 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915" returned: 0 in 0.693s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:42 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:13:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:42 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 Apr 29 09:13:42 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:46 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875" returned: 0 in 4.464s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:46 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac44559-6282-4890-90d4-4a9f72562b8b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:46 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 Apr 29 09:13:46 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:47 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915" returned: 0 in 0.898s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:47 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:13:47 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Converted 1024.00 MB image at 229.33 MB/s Apr 29 09:13:47 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 is being set with open permissions: ugo+rw Apr 29 09:13:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:47 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 Apr 29 09:13:47 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:48 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875" returned: 0 in 0.591s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-0770b79a-50f8-488d-8d53-bd412036e875" released by "_copy_volume_from_snapshot" :: held 7.383s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Acquiring lock "cinder-quobyte-538c9b4c-5587-4c85-bb0b-1acd41c73bc6" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-538c9b4c-5587-4c85-bb0b-1acd41c73bc6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Deleting offline snapshot 538c9b4c-5587-4c85-bb0b-1acd41c73bc6 of volume e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] snapshot_file for this snap is: volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cad1b0-3e96-4652-b156-8fef987e09fb]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:48 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 Apr 29 09:13:48 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:49 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6" returned: 0 in 0.690s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e08afe76-518d-4ebb-a220-57ed06a34915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:13:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d33e2-e81c-4b76-9e94-dd83eaa7f6d1]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:49 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 Apr 29 09:13:49 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:49 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=76,cinder:UPDATE=83,cinder:DELETE=9,cinder:INSERT=20 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:13:49 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915" returned: 0 in 0.678s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:49 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 Apr 29 09:13:49 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:50 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6" returned: 0 in 0.645s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:50 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6 Apr 29 09:13:50 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:50 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915.538c9b4c-5587-4c85-bb0b-1acd41c73bc6" returned: 0 in 0.571s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-538c9b4c-5587-4c85-bb0b-1acd41c73bc6" released by "_delete_snapshot" :: held 2.663s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.123s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.702s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-495884842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e2238f-517e-4333-870f-5d97293275f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:36Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Creating volume 40e2238f-517e-4333-870f-5d97293275f3 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:51 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356fed53-6d7a-4e7c-8ed4-04970aa4935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0770b79a-50f8-488d-8d53-bd412036e875', 'volume_size': 2, 'source_volid': 'e08afe76-518d-4ebb-a220-57ed06a34915', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:51 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 1073741824 Apr 29 09:13:51 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a12baa-44d6-458f-9339-e5733e873326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:51 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Volume volume-0770b79a-50f8-488d-8d53-bd412036e875 (0770b79a-50f8-488d-8d53-bd412036e875): created successfully Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a12baa-44d6-458f-9339-e5733e873326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Flow 'volume_create_manager' (8915d2da-5e80-4925-b876-5c4ae04b96e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:51 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-35e464ab-52da-41da-b63c-6ab98bf9ad8b tempest-VolumesCloneTest-1227724045 None] Created volume successfully. Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "cinder-0770b79a-50f8-488d-8d53-bd412036e875-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-0770b79a-50f8-488d-8d53-bd412036e875-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "cinder-quobyte-0770b79a-50f8-488d-8d53-bd412036e875" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-0770b79a-50f8-488d-8d53-bd412036e875" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3873b62b-7410-4287-8483-54713d0f88ed]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:51 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 1073741824" returned: 0 in 0.802s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:51 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 Apr 29 09:13:51 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:51 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 Apr 29 09:13:51 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:52 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3" returned: 0 in 0.571s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.794s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1458814528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7fd06c-dc63-4585-94ad-3a4230f08083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:37Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Creating volume db7fd06c-dc63-4585-94ad-3a4230f08083 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:52 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a06e566-118d-4853-a8bf-ced053b20dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e2238f-517e-4333-870f-5d97293275f3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:52 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:52 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 1073741824 Apr 29 09:13:52 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862cacc5-f81c-4098-833c-0d9b1f870265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875" returned: 0 in 0.674s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:52 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Volume volume-40e2238f-517e-4333-870f-5d97293275f3 (40e2238f-517e-4333-870f-5d97293275f3): created successfully Apr 29 09:13:52 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875 Apr 29 09:13:52 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862cacc5-f81c-4098-833c-0d9b1f870265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (b40a1fa5-7b7e-4eb4-a18f-6a48fc045605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:52 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fbec9098-d633-421a-a3ad-d7c38a39b756 tempest-CreateVolumesFromImageTest-1216825926 None] Created volume successfully. Apr 29 09:13:53 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-0770b79a-50f8-488d-8d53-bd412036e875" returned: 0 in 0.584s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-0770b79a-50f8-488d-8d53-bd412036e875" released by "delete_volume" :: held 1.298s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Created reservations ['81799641-6c8c-4163-ad9f-1554f60fba84', '4d64866f-89b4-4fcd-bb00-697fa9c6611f', '75ca5d29-3740-422d-8bc3-3def615eef2a', 'd744a42b-9fcf-45ff-b9cd-08ec98623cbf'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:53 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:53 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:53 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 1073741824" returned: 0 in 0.782s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:53 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 Apr 29 09:13:53 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:53 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.594s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Deleted volume successfully. Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-62414423-d408-4a90-ac64-3b4811eebd10 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-0770b79a-50f8-488d-8d53-bd412036e875-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:53 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083" returned: 0 in 0.586s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.847s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-92819896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ff8490-2bd6-41e6-8809-ad4165d01488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:37Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Creating volume 46ff8490-2bd6-41e6-8809-ad4165d01488 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:53 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25220b57-af15-45e0-abe7-e14f416fc9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7fd06c-dc63-4585-94ad-3a4230f08083', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:53 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 1073741824 Apr 29 09:13:53 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a487f01-457a-4938-8108-fde37bd9c2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:53 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Volume volume-db7fd06c-dc63-4585-94ad-3a4230f08083 (db7fd06c-dc63-4585-94ad-3a4230f08083): created successfully Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a487f01-457a-4938-8108-fde37bd9c2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (79e118d4-b094-42c4-8a7a-587e20e654e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-41d31986-6a89-487e-9b80-699af4336fc5 tempest-CreateVolumesFromImageTest-1216825926 None] Created volume successfully. Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "cinder-e08afe76-518d-4ebb-a220-57ed06a34915-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-e08afe76-518d-4ebb-a220-57ed06a34915-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "cinder-quobyte-e08afe76-518d-4ebb-a220-57ed06a34915" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-e08afe76-518d-4ebb-a220-57ed06a34915" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1932be83-a47a-43fb-867a-660aaad65d6f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:54 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 Apr 29 09:13:54 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:54 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 1073741824" returned: 0 in 0.783s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:54 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 Apr 29 09:13:54 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:54 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915" returned: 0 in 0.689s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:54 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915 Apr 29 09:13:54 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:55 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488" returned: 0 in 0.588s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.942s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497748471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97af0021-e74b-478d-a9a9-170836c6b0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:37Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Creating volume 97af0021-e74b-478d-a9a9-170836c6b0f0 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:55 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:55 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 1073741824 Apr 29 09:13:55 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fce4019-d1e8-49fa-873b-19f32e906521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ff8490-2bd6-41e6-8809-ad4165d01488', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610f147b-798d-4d0d-b212-9688a40d90a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:55 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Volume volume-46ff8490-2bd6-41e6-8809-ad4165d01488 (46ff8490-2bd6-41e6-8809-ad4165d01488): created successfully Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610f147b-798d-4d0d-b212-9688a40d90a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (53e6ca54-f9d8-4a3f-8ea6-67ec88e4e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:55 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9df34554-35b3-4988-a3b4-54b55b4b52f5 tempest-CreateVolumesFromImageTest-1216825926 None] Created volume successfully. Apr 29 09:13:55 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e08afe76-518d-4ebb-a220-57ed06a34915" returned: 0 in 0.600s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-quobyte-e08afe76-518d-4ebb-a220-57ed06a34915" released by "delete_volume" :: held 1.352s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Created reservations ['06e98892-dba1-49bb-9675-9fa8a20b32fc', '22484156-ee7c-40f8-899e-58032f7945a7', '2fd267b0-7a16-4314-a29f-b84ea522aecf', 'f1b00b95-f8a3-4e4b-be9b-1c5e657349ee'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:55 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:13:55 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:56 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.587s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:13:56 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Deleted volume successfully. Apr 29 09:13:56 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 1073741824" returned: 0 in 0.821s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-fb5da5a3-a16c-4f81-acaa-4e0e4af6e021 tempest-VolumesCloneTest-1227724045 None] Lock "cinder-e08afe76-518d-4ebb-a220-57ed06a34915-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:56 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 Apr 29 09:13:56 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:56 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0" returned: 0 in 0.580s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.087s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968991095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f3b77e-c5ab-4425-a0a6-7284ba501458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00718778dade4b8eae806cf7a2b6ab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:38Z,use_quota=True,user_id='28e73cc6ea2e4c03b2828784ea7aa7b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Creating volume 74f3b77e-c5ab-4425-a0a6-7284ba501458 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:56 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffbe53d-f856-4746-9b67-c0fa576369c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97af0021-e74b-478d-a9a9-170836c6b0f0', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:56 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 1073741824 Apr 29 09:13:56 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb0ce67-eada-443f-88ec-75391d6b0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:56 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Volume volume-97af0021-e74b-478d-a9a9-170836c6b0f0 (97af0021-e74b-478d-a9a9-170836c6b0f0): created successfully Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb0ce67-eada-443f-88ec-75391d6b0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (f0f63bae-7cca-41bb-b97a-aef794e328e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:56 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2ec9a38e-ed03-4879-83b6-6b74e6b68ed9 tempest-CreateVolumesFromImageTest-1216825926 None] Created volume successfully. Apr 29 09:13:57 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 1073741824" returned: 0 in 0.819s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:57 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 Apr 29 09:13:57 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:58 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458" returned: 0 in 0.586s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.402s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1628586809',display_name='tempest-VolumesGetTest-Volume-117802889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e7a5e3-28a4-4329-b6e4-aaa9f4d091db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:39Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Creating volume 13e7a5e3-28a4-4329-b6e4-aaa9f4d091db {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:13:58 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb1f457-94cd-46f7-9ee3-13ee09c2fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f3b77e-c5ab-4425-a0a6-7284ba501458', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2024c869-bfc4-4878-94de-49e8c9935198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:58 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db 1073741824 Apr 29 09:13:58 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Volume volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 (74f3b77e-c5ab-4425-a0a6-7284ba501458): created successfully Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2024c869-bfc4-4878-94de-49e8c9935198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Flow 'volume_create_manager' (c11ac8a8-05cb-49d3-b662-67a7a8c1a767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7f580a8b-861d-498e-830e-fbbaf18ff7bf tempest-CreateVolumesFromImageTest-1216825926 None] Created volume successfully. Apr 29 09:13:58 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db 1073741824" returned: 0 in 0.764s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:59 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db Apr 29 09:13:59 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Flow 'volume_create_manager' (a25773db-42ea-4f6a-9e3a-cde560906c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7421f2f7-5048-40f6-a28e-bbc957d10dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7421f2f7-5048-40f6-a28e-bbc957d10dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1948933526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2914b3-2ff0-46b5-903e-b5a710cbe797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329f06d038604d6bbffcfcf240658ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:59Z,use_quota=True,user_id='380000711b6b44a1afe80f00fd0bf997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b45b7d-0a3f-470c-a1a9-e5260b586bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b45b7d-0a3f-470c-a1a9-e5260b586bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda32605-1257-455d-a08d-dc2deb6ffa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.image.glance [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Creating Keystone auth plugin from conf {{(pid=84004) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-74f3b77e-c5ab-4425-a0a6-7284ba501458-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-74f3b77e-c5ab-4425-a0a6-7284ba501458-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-quobyte-74f3b77e-c5ab-4425-a0a6-7284ba501458" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-74f3b77e-c5ab-4425-a0a6-7284ba501458" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cd6885-7d06-471e-af2e-0be0de7f3899]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:13:59 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 Apr 29 09:13:59 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda32605-1257-455d-a08d-dc2deb6ffa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc2914b3-2ff0-46b5-903e-b5a710cbe797', 'volume_name': 'volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:59 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c1ba02-1d64-487a-a3b0-81fddc95ed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c1ba02-1d64-487a-a3b0-81fddc95ed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8009b5-c82f-466f-8c92-4ccebfeb9b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:59 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Volume cc2914b3-2ff0-46b5-903e-b5a710cbe797: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Trying to clone cc2914b3-2ff0-46b5-903e-b5a710cbe797 from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a at location (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]). {{(pid=84004) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db" returned: 0 in 0.670s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c714dc-186d-44fd-b69a-a8c53844b03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e51f844-d343-4d23-be69-39016310b3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:13:59 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Volume volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db (13e7a5e3-28a4-4329-b6e4-aaa9f4d091db): created successfully Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e51f844-d343-4d23-be69-39016310b3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:13:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (b3ba34d4-e9af-4f61-b635-12e16b1f050c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:13:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-23900826-c29d-4a04-9684-7903fc2e58fd tempest-VolumesGetTest-985433763 None] Created volume successfully. Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 09:14:00 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Image download 20.69 MB at 20.69 MB/s Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d34e2d-0561-4d13-a458-1cc08146f9f4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:00 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD Apr 29 09:14:00 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:00 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458" returned: 0 in 0.756s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:00 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458 Apr 29 09:14:00 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Lock "cinder-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f11edba-81a1-44e0-9107-75130a1bd61c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:00 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db Apr 29 09:14:00 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:00 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a is fetched for user 380000711b6b44a1afe80f00fd0bf997. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 09:14:00 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74f3b77e-c5ab-4425-a0a6-7284ba501458" returned: 0 in 0.605s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7f8e00-575b-44be-b3ed-f9ddc082173e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-74f3b77e-c5ab-4425-a0a6-7284ba501458" released by "delete_volume" :: held 1.424s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:00 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Created reservations ['0b5d261e-baa5-42fb-8c1f-1ceb811a3b08', '480631ca-0caf-4a61-bf69-41b975af9a2f', '3adfd6a3-2c17-47e2-a100-ba6054bba67a', '39df2d1d-a4bb-4b97-af0a-a2825b814c4d'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:01 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD Apr 29 09:14:01 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:01 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:01 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:01 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db" returned: 0 in 0.751s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:01 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db Apr 29 09:14:01 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:01 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.593s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Deleted volume successfully. Apr 29 09:14:01 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1948933526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2914b3-2ff0-46b5-903e-b5a710cbe797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329f06d038604d6bbffcfcf240658ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:59Z,use_quota=True,user_id='380000711b6b44a1afe80f00fd0bf997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Creating volume cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:01 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8d85d8af-1af4-4d31-8054-4c4e98dfed3f tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-74f3b77e-c5ab-4425-a0a6-7284ba501458-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-97af0021-e74b-478d-a9a9-170836c6b0f0-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:01 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 1073741824 Apr 29 09:14:01 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-97af0021-e74b-478d-a9a9-170836c6b0f0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-quobyte-97af0021-e74b-478d-a9a9-170836c6b0f0" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-97af0021-e74b-478d-a9a9-170836c6b0f0" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd43008f-d2bc-4e16-847e-4f718c2bc283]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:01 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db" returned: 0 in 0.683s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db" released by "delete_volume" :: held 1.475s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:01 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 Apr 29 09:14:01 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:01 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Created reservations ['c9e84664-555c-4ba0-a55d-ddee634cd8b1', '3027abaf-b53c-4e84-9656-05a2fb12300a', '47127cbd-7205-4b6d-99db-b13c65f4c5ef', '4c321864-4517-47c5-85e2-6fb331cc8fa0'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:02 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:02 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:02 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 1073741824" returned: 0 in 0.866s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:02 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0" returned: 0 in 0.757s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:02 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:02 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:02 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0 Apr 29 09:14:02 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:02 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:02 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:02 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.638s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:02 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Deleted volume successfully. Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Lock "cinder-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebc0355f-0063-4bca-bb93-a26279245594 tempest-VolumesGetTest-985433763 None] Lock "cinder-13e7a5e3-28a4-4329-b6e4-aaa9f4d091db-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a518bc9d-d9ac-4488-8394-a1b4c06ee895]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:02 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 Apr 29 09:14:02 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:03 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.653s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:03 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97af0021-e74b-478d-a9a9-170836c6b0f0" returned: 0 in 0.715s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-97af0021-e74b-478d-a9a9-170836c6b0f0" released by "delete_volume" :: held 1.520s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=94,cinder:INSERT=32,cinder:UPDATE=139,cinder:DELETE=12 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:14:03 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 0 in 0.694s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Attempting download of 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume cc2914b3-2ff0-46b5-903e-b5a710cbe797. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Created reservations ['e1ccdadf-4f38-4e1d-80e5-c1798866b000', '9ae2e6e3-5bc8-4e1f-9053-2fab3a5e6f99', '7342c707-ca7a-4d26-934f-846e10aa1ef3', '8bae16e8-1a3d-498f-b8d7-35f4c26f51a6'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8bce7d-8265-44b9-9976-ba87be7dde40]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_apr046b6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:03 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:03 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:03 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_apr046b6 Apr 29 09:14:03 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:03 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" returned: 0 in 0.810s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:03 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3 Apr 29 09:14:03 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-46ff8490-2bd6-41e6-8809-ad4165d01488-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-46ff8490-2bd6-41e6-8809-ad4165d01488-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-quobyte-46ff8490-2bd6-41e6-8809-ad4165d01488" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:04 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.644s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-46ff8490-2bd6-41e6-8809-ad4165d01488" acquired by "delete_volume" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Deleted volume successfully. Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc221b4c-a04a-4311-820d-1ec04161ec5f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:04 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-97aef0f3-5af0-4bf9-a5b2-a551be607b62 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-97af0021-e74b-478d-a9a9-170836c6b0f0-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_apr046b6" returned: 0 in 0.760s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_apr046b6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:04 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 Apr 29 09:14:04 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:04 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_apr046b6 Apr 29 09:14:04 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:04 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" returned: 0 in 0.682s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3" released by "delete_volume" :: held 1.548s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Created reservations ['1b8c3656-ba97-4c9e-a2ad-dc87f8db2d82', '412a15cf-a10e-4da2-9a55-57b057c09b6e', 'b66b7805-9866-4cb9-a86b-6f132ca862b2', '19f43959-b8d4-4ca9-8a83-1c5020e5e13a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:04 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:04 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:04 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_apr046b6" returned: 1 in 0.676s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_apr046b6' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d3606-9c3d-4dc5-9a10-44daa01c5522]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:04 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488" returned: 0 in 0.737s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:04 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488 Apr 29 09:14:04 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:04 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD Apr 29 09:14:04 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-ad114885-6e88-4651-8296-4c11313d8136-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Lock "cinder-ad114885-6e88-4651-8296-4c11313d8136-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:05 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.650s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Deleted volume successfully. Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-05abee60-4616-48d0-8d00-88567f43bf30 tempest-VolumesGetTest-985433763 None] Lock "cinder-3ddb8b09-cfc1-48e0-aa0c-d61ffeea6fe3-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-ad114885-6e88-4651-8296-4c11313d8136" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-ad114885-6e88-4651-8296-4c11313d8136" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8641a8c-6b98-4b84-817d-2a3190a012f4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:05 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 Apr 29 09:14:05 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:05 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-46ff8490-2bd6-41e6-8809-ad4165d01488" returned: 0 in 0.664s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-46ff8490-2bd6-41e6-8809-ad4165d01488" released by "delete_volume" :: held 1.453s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:05 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Created reservations ['0983d689-c7ba-417b-8f2a-ed3608d55e8c', 'b8f53d04-0d0c-4499-9ced-30caece0a5b8', 'fb6559ec-a8cf-417f-9d14-738914bc36e3', '2f9a7e88-6e50-4b87-a4df-e8985c106d8f'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] 94604fed-be0e-4d2f-b51a-4c6bf32c717a was qcow2, converting to raw {{(pid=84004) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:05 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:05 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:05 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:05 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:05 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136" returned: 0 in 0.742s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:05 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136 Apr 29 09:14:06 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-db7fd06c-dc63-4585-94ad-3a4230f08083-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-db7fd06c-dc63-4585-94ad-3a4230f08083-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-quobyte-db7fd06c-dc63-4585-94ad-3a4230f08083" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-db7fd06c-dc63-4585-94ad-3a4230f08083" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:06 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.682s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac227de-981b-4969-9786-358cfcef218e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Deleted volume successfully. Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0d2aaccb-1b0b-425d-963d-40168ec5c017 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-46ff8490-2bd6-41e6-8809-ad4165d01488-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:06 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 Apr 29 09:14:06 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:06 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-ad114885-6e88-4651-8296-4c11313d8136" returned: 0 in 0.702s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-ad114885-6e88-4651-8296-4c11313d8136" released by "delete_volume" :: held 1.532s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Created reservations ['b85da735-aeeb-417e-880e-76e7436b5b17', 'ab45f6bf-fb0d-40cf-9353-e7237511bc7a', 'd6240d17-99a1-474f-a0f8-236d10b5a254', 'bc3eb0e0-8e66-4a37-b46d-abdf591f6479'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:06 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:06 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:07 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083" returned: 0 in 0.799s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:07 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083 Apr 29 09:14:07 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:07 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.681s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:07 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Deleted volume successfully. Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-79a4fd36-ffed-4d10-8856-6b1dc382fd4e tempest-VolumesGetTest-985433763 None] Lock "cinder-ad114885-6e88-4651-8296-4c11313d8136-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:07 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 0 in 2.037s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_y51lti1udevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:14:07 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Converted 112.00 MB image at 54.95 MB/s Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:07 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 1G Apr 29 09:14:07 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:07 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db7fd06c-dc63-4585-94ad-3a4230f08083" returned: 0 in 0.637s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-db7fd06c-dc63-4585-94ad-3a4230f08083" released by "delete_volume" :: held 1.500s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Created reservations ['bc12c82e-8021-4cbe-b54b-d1d93e365948', '4c9a4a10-7019-4d1a-b529-41d7275f252d', 'ee100ea8-3b37-48ec-aa23-dda10b20256c', '634e7315-db0a-48fb-858b-7b77a318ee9f'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:08 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:08 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (49b85c88-0168-42c9-aafe-7f09fbbce696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efffcfdd-70a6-49eb-aa2d-b1dc0cd11ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efffcfdd-70a6-49eb-aa2d-b1dc0cd11ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-275615211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671a8475-516a-470b-a505-72caca81f456,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:08Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1099dd54-7a81-420b-95be-d04345671e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1099dd54-7a81-420b-95be-d04345671e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb390460-8c84-4056-9ec7-3f4aa5528551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.image.glance [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Creating Keystone auth plugin from conf {{(pid=84004) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 09:14:08 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 1G" returned: 0 in 0.675s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[485627fe-7ccc-4292-8939-73c673ce7991]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb390460-8c84-4056-9ec7-3f4aa5528551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '671a8475-516a-470b-a505-72caca81f456', 'volume_name': 'volume-671a8475-516a-470b-a505-72caca81f456', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3499bd-9e93-488d-bf74-0a74e7929062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3499bd-9e93-488d-bf74-0a74e7929062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12798c23-17d1-4289-b5be-4b8979cb8411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:08 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Volume 671a8475-516a-470b-a505-72caca81f456: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-671a8475-516a-470b-a505-72caca81f456', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Trying to clone 671a8475-516a-470b-a505-72caca81f456 from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a at location (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]). {{(pid=84004) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 09:14:08 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:08 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-40e2238f-517e-4333-870f-5d97293275f3-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:08 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.696s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-40e2238f-517e-4333-870f-5d97293275f3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Deleted volume successfully. Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-269f0ee0-9912-464a-9187-c2f6a839eddb tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-db7fd06c-dc63-4585-94ad-3a4230f08083-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "cinder-quobyte-40e2238f-517e-4333-870f-5d97293275f3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 09:14:08 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Image download 20.69 MB at 20.69 MB/s Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-40e2238f-517e-4333-870f-5d97293275f3" acquired by "delete_volume" :: waited 0.043s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[827f99aa-6016-421a-86e0-962bf487d0c6]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[709e2887-7eb7-4546-93df-bbf11e43f973]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:09 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD Apr 29 09:14:09 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:09 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 Apr 29 09:14:09 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:09 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 0 in 0.793s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:09 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:09 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:09 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD" returned: 0 in 0.668s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a is fetched for user 9d5d02835976411da707941c7957b8ac. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 09:14:09 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3" returned: 0 in 0.713s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:09 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3 Apr 29 09:14:09 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[addae6ee-874e-4009-a939-de201776326e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:09 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD Apr 29 09:14:09 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:09 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 1 in 0.737s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Downloaded image 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume cc2914b3-2ff0-46b5-903e-b5a710cbe797 successfully. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a for user 380000711b6b44a1afe80f00fd0bf997 is deleted. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Marking volume cc2914b3-2ff0-46b5-903e-b5a710cbe797 as bootable. {{(pid=84004) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Copying metadata from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a to cc2914b3-2ff0-46b5-903e-b5a710cbe797. {{(pid=84004) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 09:14:09 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Creating volume glance metadata for volume cc2914b3-2ff0-46b5-903e-b5a710cbe797 backed by image 94604fed-be0e-4d2f-b51a-4c6bf32c717a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84004) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8009b5-c82f-466f-8c92-4ccebfeb9b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53460fe7-f2c6-4876-ac5b-2455fa0dbb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:10 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Volume volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 (cc2914b3-2ff0-46b5-903e-b5a710cbe797): created successfully Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53460fe7-f2c6-4876-ac5b-2455fa0dbb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Flow 'volume_create_manager' (a25773db-42ea-4f6a-9e3a-cde560906c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-de6141ae-d015-4f70-9eae-82e6ed2c71b1 tempest-VolumesExtendTest-1620159938 None] Created volume successfully. Apr 29 09:14:10 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-40e2238f-517e-4333-870f-5d97293275f3" returned: 0 in 0.615s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-quobyte-40e2238f-517e-4333-870f-5d97293275f3" released by "delete_volume" :: held 1.376s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Created reservations ['01706985-2887-4b66-a6d8-f1a5354b7d11', '22330df4-35bf-4925-8402-66e16c6db87a', '6b583a15-9cf7-4dc6-abb7-5202d69ac3a5', '5cc9fbd2-b94a-47c5-b2ad-0a9548fad6cf'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:10 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:10 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:10 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD" returned: 0 in 0.715s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-275615211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671a8475-516a-470b-a505-72caca81f456,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:08Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Creating volume 671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:10 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:10 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 1073741824 Apr 29 09:14:10 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:10 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.595s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Deleted volume successfully. Apr 29 09:14:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-3bb70e87-5ac4-4fd0-b032-bd35c35f1b75 tempest-CreateVolumesFromImageTest-1216825926 None] Lock "cinder-40e2238f-517e-4333-870f-5d97293275f3-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:11 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 1073741824" returned: 0 in 0.880s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:11 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 Apr 29 09:14:11 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:11 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456" returned: 0 in 0.590s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.724s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Attempting download of 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume 671a8475-516a-470b-a505-72caca81f456. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da6947a-aaf9-4ca2-b461-ffafd5b1c890]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46bc49-79d2-4a46-a44d-1604690b27d3]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_auze5cvv {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:12 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:12 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:12 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_auze5cvv Apr 29 09:14:12 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:12 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_auze5cvv" returned: 0 in 0.711s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_auze5cvv {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:12 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 0 in 0.773s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:12 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_auze5cvv Apr 29 09:14:12 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:12 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:12 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:13 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_auze5cvv" returned: 1 in 0.674s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94604fed-be0e-4d2f-b51a-4c6bf32c717a_auze5cvv' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f026a-ba4e-41a6-9a6d-287ac4852ea2]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:13 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 1 in 0.685s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 2G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 2G" returned: 0 in 0.086s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.603s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:13 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD Apr 29 09:14:13 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-6d5a6cf0-6a35-427d-b411-dd286974500e tempest-VolumesExtendTest-1620159938 None] Extend volume completed successfully. Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (b0d30b9c-ea85-4ac7-bffe-0324efa8fcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e0877d-7c5f-4401-9e0c-6d503c94a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e0877d-7c5f-4401-9e0c-6d503c94a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1721832282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24238f2-ff8c-48d3-8502-711cd3001ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe56e1b05eb940b08694e5211dbc6975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:14Z,use_quota=True,user_id='361c94b225a44bf6b74b172e3133c338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7373bcb-69c3-42d2-a706-09d6c3c0c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7373bcb-69c3-42d2-a706-09d6c3c0c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e19877-2aff-47e2-848b-8ce30a6d6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e19877-2aff-47e2-848b-8ce30a6d6edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24238f2-ff8c-48d3-8502-711cd3001ac6', 'volume_name': 'volume-c24238f2-ff8c-48d3-8502-711cd3001ac6', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e7b5b6-81d5-48da-9273-1db0b384c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e7b5b6-81d5-48da-9273-1db0b384c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ba79c4-aade-47ac-b975-6c852487bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:13 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Volume c24238f2-ff8c-48d3-8502-711cd3001ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24238f2-ff8c-48d3-8502-711cd3001ac6', 'volume_size': 1} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1721832282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24238f2-ff8c-48d3-8502-711cd3001ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe56e1b05eb940b08694e5211dbc6975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:14Z,use_quota=True,user_id='361c94b225a44bf6b74b172e3133c338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Creating volume c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:13 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:13 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 1073741824 Apr 29 09:14:13 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:14 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD" returned: 0 in 0.682s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] 94604fed-be0e-4d2f-b51a-4c6bf32c717a was qcow2, converting to raw {{(pid=84004) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:14 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 Apr 29 09:14:14 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Acquiring lock "cinder-cc2914b3-2ff0-46b5-903e-b5a710cbe797-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Lock "cinder-cc2914b3-2ff0-46b5-903e-b5a710cbe797-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Acquiring lock "cinder-quobyte-cc2914b3-2ff0-46b5-903e-b5a710cbe797" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:14 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 1073741824" returned: 0 in 0.948s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-cc2914b3-2ff0-46b5-903e-b5a710cbe797" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[43022e84-ec49-4252-9a2f-5c3d8f6ba5b2]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:14 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 Apr 29 09:14:14 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:14 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:14 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:15 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6" returned: 0 in 0.613s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ba79c4-aade-47ac-b975-6c852487bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24238f2-ff8c-48d3-8502-711cd3001ac6', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d3175-aac5-4fd0-baea-4be5b4143188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:15 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Volume volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 (c24238f2-ff8c-48d3-8502-711cd3001ac6): created successfully Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d3175-aac5-4fd0-baea-4be5b4143188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (b0d30b9c-ea85-4ac7-bffe-0324efa8fcbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:15 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0b772d95-2184-416e-9547-1e4cfaac4cb0 tempest-VolumeDependencyTests-2110022883 None] Created volume successfully. Apr 29 09:14:15 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 0 in 0.758s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:15 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:15 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:16 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456" returned: 0 in 1.956s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94604fed-be0e-4d2f-b51a-4c6bf32c717a_jnir3vo5devstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:14:16 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Converted 112.00 MB image at 57.14 MB/s Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:16 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 1G Apr 29 09:14:16 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Creating offline snapshot 1690ced7-3706-4eef-8029-4a522b879345 of volume c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a449dc-9948-40db-bbf4-84347161f98a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:16 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 Apr 29 09:14:16 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:16 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 1 in 0.772s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:16 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797 Apr 29 09:14:16 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:16 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 1G" returned: 0 in 0.627s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b3d6dd-8667-48f2-8834-32ff958ef3c9]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:16 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 Apr 29 09:14:16 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:16 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6" returned: 0 in 0.705s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:16 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 1G Apr 29 09:14:16 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:16 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc2914b3-2ff0-46b5-903e-b5a710cbe797" returned: 0 in 0.604s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-cc2914b3-2ff0-46b5-903e-b5a710cbe797" released by "delete_volume" :: held 2.201s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Created reservations ['3f1ebccc-c85c-4bf4-8396-0cf67bec85bf', '897a4df1-8d03-47c7-9f5d-8001f6a2fb5c', '9fbb5405-ed4f-4cf9-a83f-be60aa6a9a5a', 'beefd557-ea60-478a-84a1-8a717a421d62'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:17 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:17 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:17 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456" returned: 0 in 0.733s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:17 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 Apr 29 09:14:17 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:17 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 1G" returned: 0 in 0.739s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:17 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 Apr 29 09:14:17 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:17 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.621s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Deleted volume successfully. Apr 29 09:14:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-74700e02-4aee-4bdb-9ece-99af9bb988cc tempest-VolumesExtendTest-1620159938 None] Lock "cinder-cc2914b3-2ff0-46b5-903e-b5a710cbe797-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:18 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456" returned: 1 in 0.711s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Downloaded image 94604fed-be0e-4d2f-b51a-4c6bf32c717a ((None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}])) to volume 671a8475-516a-470b-a505-72caca81f456 successfully. {{(pid=84004) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Temporary image 94604fed-be0e-4d2f-b51a-4c6bf32c717a for user 9d5d02835976411da707941c7957b8ac is deleted. {{(pid=84004) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.volume_utils [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Marking volume 671a8475-516a-470b-a505-72caca81f456 as bootable. {{(pid=84004) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Copying metadata from image 94604fed-be0e-4d2f-b51a-4c6bf32c717a to 671a8475-516a-470b-a505-72caca81f456. {{(pid=84004) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Creating volume glance metadata for volume 671a8475-516a-470b-a505-72caca81f456 backed by image 94604fed-be0e-4d2f-b51a-4c6bf32c717a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84004) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 09:14:18 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:18 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 is being set with open permissions: ugo+rw Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:18 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 Apr 29 09:14:18 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12798c23-17d1-4289-b5be-4b8979cb8411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671a8475-516a-470b-a505-72caca81f456', 'volume_size': 1, 'image_id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1d35192a8960495f9e1d6e6a6c0d2ced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94604fed-be0e-4d2f-b51a-4c6bf32c717a', 'created_at': datetime.datetime(2026, 4, 29, 7, 0, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 0, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94604fed-be0e-4d2f-b51a-4c6bf32c717a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60dd119-c20d-4321-8102-a85355bd9309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:18 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Volume volume-671a8475-516a-470b-a505-72caca81f456 (671a8475-516a-470b-a505-72caca81f456): created successfully Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60dd119-c20d-4321-8102-a85355bd9309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (49b85c88-0168-42c9-aafe-7f09fbbce696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e70e9298-c706-4669-800a-9460b4afcbb4 tempest-VolumesGetTest-985433763 None] Created volume successfully. Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Flow 'volume_create_manager' (7fcea18a-5089-4dac-b80d-00586398a18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426c7c48-1736-4f94-9483-da94170f3d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426c7c48-1736-4f94-9483-da94170f3d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-308159317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8795ecb6-26db-4ad2-b249-97637fbc7b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329f06d038604d6bbffcfcf240658ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:18Z,use_quota=True,user_id='380000711b6b44a1afe80f00fd0bf997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff237ea2-48b4-4d63-9f61-3214326612d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff237ea2-48b4-4d63-9f61-3214326612d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3767268-e450-4f99-a95d-20491b55db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3767268-e450-4f99-a95d-20491b55db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8795ecb6-26db-4ad2-b249-97637fbc7b39', 'volume_name': 'volume-8795ecb6-26db-4ad2-b249-97637fbc7b39', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdad285-38bc-454e-9ae4-f6f7c31e4d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdad285-38bc-454e-9ae4-f6f7c31e4d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184a1bd1-6468-4a08-8807-cd624938432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:18 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Volume 8795ecb6-26db-4ad2-b249-97637fbc7b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8795ecb6-26db-4ad2-b249-97637fbc7b39', 'volume_size': 1} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:18 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345" returned: 0 in 0.579s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:18 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.info Apr 29 09:14:18 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:19 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (5943f8d0-5fd0-429b-8557-50a996e0cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b582ec76-5e78-4c80-a15f-af00e9d07903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.info" returned: 0 in 0.620s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:19 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.info is being set with open permissions: ugo+rw Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:19 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.info Apr 29 09:14:19 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b582ec76-5e78-4c80-a15f-af00e9d07903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-210666337',display_name='tempest-VolumesGetTest-Volume-1584971437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519abc2c-e5dc-4951-b69a-7d3104c48cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:19Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760fc38f-fb86-40cd-a68c-89bec96091c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760fc38f-fb86-40cd-a68c-89bec96091c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce6c019-c846-4047-8b78-22c3efecbffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce6c019-c846-4047-8b78-22c3efecbffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519abc2c-e5dc-4951-b69a-7d3104c48cb1', 'volume_name': 'volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9732e057-fcf6-430b-a732-aa087ff2193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9732e057-fcf6-430b-a732-aa087ff2193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e46cdf7-09e3-4118-96de-efb9388697d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:19 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Volume 519abc2c-e5dc-4951-b69a-7d3104c48cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1', 'volume_size': 1} Apr 29 09:14:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:20 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.info" returned: 0 in 0.558s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.973s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-308159317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8795ecb6-26db-4ad2-b249-97637fbc7b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329f06d038604d6bbffcfcf240658ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:18Z,use_quota=True,user_id='380000711b6b44a1afe80f00fd0bf997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Creating volume 8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:20 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:20 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 1073741824 Apr 29 09:14:20 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1b5ceb94-6a6f-48b4-9e09-93996be18fb7 tempest-VolumeDependencyTests-2110022883 None] Create snapshot completed successfully Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (acf9f8e0-631d-4da5-8b0c-4986ff4ac5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa935583-b085-433e-99d3-5232bbe38e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa935583-b085-433e-99d3-5232bbe38e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-420383098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b2713d-98ab-4bde-b39b-c467e8b11696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe56e1b05eb940b08694e5211dbc6975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1690ced7-3706-4eef-8029-4a522b879345,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:21Z,use_quota=True,user_id='361c94b225a44bf6b74b172e3133c338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d30e3e1-0685-4d82-bda6-8ad1c6322bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d30e3e1-0685-4d82-bda6-8ad1c6322bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a486e7-5ade-4285-9383-d7d9235a00ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a486e7-5ade-4285-9383-d7d9235a00ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04b2713d-98ab-4bde-b39b-c467e8b11696', 'volume_name': 'volume-04b2713d-98ab-4bde-b39b-c467e8b11696', 'volume_size': 1, 'snapshot_id': '1690ced7-3706-4eef-8029-4a522b879345'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1070d9a-d3f5-4957-8605-7ae5f1a68f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1070d9a-d3f5-4957-8605-7ae5f1a68f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de8e477-266f-4067-84cb-f2485d8f6898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:20 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Volume 04b2713d-98ab-4bde-b39b-c467e8b11696: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04b2713d-98ab-4bde-b39b-c467e8b11696', 'volume_size': 1, 'snapshot_id': '1690ced7-3706-4eef-8029-4a522b879345'} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:20 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 1073741824" returned: 0 in 0.783s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:20 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 Apr 29 09:14:20 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:21 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39" returned: 0 in 0.615s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.956s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-210666337',display_name='tempest-VolumesGetTest-Volume-1584971437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519abc2c-e5dc-4951-b69a-7d3104c48cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a04863243b4bd6887806a51ab9663a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:19Z,use_quota=True,user_id='9d5d02835976411da707941c7957b8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Creating volume 519abc2c-e5dc-4951-b69a-7d3104c48cb1 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:21 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:21 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 1073741824 Apr 29 09:14:21 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184a1bd1-6468-4a08-8807-cd624938432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8795ecb6-26db-4ad2-b249-97637fbc7b39', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30048be-6147-4bf0-9afb-2422ff8a79b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:21 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Volume volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 (8795ecb6-26db-4ad2-b249-97637fbc7b39): created successfully Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30048be-6147-4bf0-9afb-2422ff8a79b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:21 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Flow 'volume_create_manager' (7fcea18a-5089-4dac-b80d-00586398a18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:21 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d0acf11a-d1d3-4db2-b865-65ef8a27ef95 tempest-VolumesExtendTest-1620159938 None] Created volume successfully. Apr 29 09:14:22 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 1073741824" returned: 0 in 0.746s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:22 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 Apr 29 09:14:22 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:22 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1" returned: 0 in 0.586s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.081s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-1690ced7-3706-4eef-8029-4a522b879345-04b2713d-98ab-4bde-b39b-c467e8b11696" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e46cdf7-09e3-4118-96de-efb9388697d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0809148f-19b6-4910-9115-a81a7795cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-1690ced7-3706-4eef-8029-4a522b879345-04b2713d-98ab-4bde-b39b-c467e8b11696" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Creating volume 04b2713d-98ab-4bde-b39b-c467e8b11696 from snapshot 1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-04b2713d-98ab-4bde-b39b-c467e8b11696" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:22 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Volume volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 (519abc2c-e5dc-4951-b69a-7d3104c48cb1): created successfully Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0809148f-19b6-4910-9115-a81a7795cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Flow 'volume_create_manager' (5943f8d0-5fd0-429b-8557-50a996e0cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-04b2713d-98ab-4bde-b39b-c467e8b11696" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] snapshot: 1690ced7-3706-4eef-8029-4a522b879345, volume: 04b2713d-98ab-4bde-b39b-c467e8b11696, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:14:22 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f8fc8a32-6f63-4068-9c34-e5749fb2dca1 tempest-VolumesGetTest-985433763 None] Created volume successfully. Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ce1267-ed06-4da7-9b81-db203016eefa]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:23 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 Apr 29 09:14:23 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:23 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345" returned: 0 in 0.690s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c24238f2-ff8c-48d3-8502-711cd3001ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e9d09-cb62-420e-8e87-0f5a1c2c412d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:23 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 Apr 29 09:14:23 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-519abc2c-e5dc-4951-b69a-7d3104c48cb1-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Lock "cinder-519abc2c-e5dc-4951-b69a-7d3104c48cb1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-519abc2c-e5dc-4951-b69a-7d3104c48cb1" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-519abc2c-e5dc-4951-b69a-7d3104c48cb1" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[725724f6-ef51-4820-9653-4791bc041f1b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:24 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 Apr 29 09:14:24 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:24 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6" returned: 0 in 0.737s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:24 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:14:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:24 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 Apr 29 09:14:24 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:24 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:24 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 Apr 29 09:14:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1" returned: 0 in 0.728s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:24 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:25 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-519abc2c-e5dc-4951-b69a-7d3104c48cb1" returned: 0 in 0.742s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-519abc2c-e5dc-4951-b69a-7d3104c48cb1" released by "delete_volume" :: held 1.528s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Created reservations ['dc4e3559-985e-429e-bb10-9c2462a9fcd7', 'fee4c83d-4b46-45ad-9207-0a0c1f55e84e', 'fa6a7836-ef1c-494e-8cad-9f7891dd78e2', '768b9e6b-2110-4ddd-ab22-850593637109'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:25 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:25 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-671a8475-516a-470b-a505-72caca81f456-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Lock "cinder-671a8475-516a-470b-a505-72caca81f456-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Acquiring lock "cinder-quobyte-671a8475-516a-470b-a505-72caca81f456" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-671a8475-516a-470b-a505-72caca81f456" acquired by "delete_volume" :: waited 0.049s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:26 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a75f14-8616-4251-848f-317b38e4fe41]: (4, 'raw') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:27 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 Apr 29 09:14:27 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:27 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 2.235s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:27 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:27 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Deleted volume successfully. Apr 29 09:14:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f81f6ca-13b0-4e0c-871d-6fb4dfedcc73 tempest-VolumesGetTest-985433763 None] Lock "cinder-519abc2c-e5dc-4951-b69a-7d3104c48cb1-delete_volume" released by "delete_volume" :: held 4.157s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:28 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456" returned: 0 in 2.170s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:28 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 Apr 29 09:14:28 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:29 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696" returned: 0 in 5.062s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:29 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45d2a88-20a5-4707-9f6d-568b5bfabe04]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:29 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 Apr 29 09:14:29 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:29 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456" returned: 1 in 0.947s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456' failed. Not Retrying. {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 09:14:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:29 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456 Apr 29 09:14:29 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:30 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-671a8475-516a-470b-a505-72caca81f456" returned: 0 in 0.586s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Lock "cinder-quobyte-671a8475-516a-470b-a505-72caca81f456" released by "delete_volume" :: held 3.830s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:30 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6" returned: 0 in 0.862s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:14:30 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Converted 1024.00 MB image at 202.24 MB/s Apr 29 09:14:30 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 is being set with open permissions: ugo+rw Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:30 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 Apr 29 09:14:30 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Created reservations ['e76b2f18-f617-40f3-af0b-e57446cd7259', 'c2434f60-589d-47a7-a965-6f850915169e', 'fc704e86-2afc-400f-be93-401739552754', 'c2270fd4-2b95-4fcf-bc1b-cc7df7b8d3c8'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:30 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:30 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:31 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696" returned: 0 in 0.643s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-04b2713d-98ab-4bde-b39b-c467e8b11696" released by "_copy_volume_from_snapshot" :: held 8.085s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-1690ced7-3706-4eef-8029-4a522b879345-04b2713d-98ab-4bde-b39b-c467e8b11696" released by "_create_volume_from_snapshot" :: held 8.127s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.156s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.152s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Creating offline snapshot 493acbb0-a234-4215-bca2-dc34292e67dc of volume 8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:14:31 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.589s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cb9ac8-7dea-42b7-a632-3202736c5c96]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de8e477-266f-4067-84cb-f2485d8f6898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b2713d-98ab-4bde-b39b-c467e8b11696', 'volume_size': 1, 'snapshot_id': '1690ced7-3706-4eef-8029-4a522b879345'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58377fb-4267-49fa-928c-0e86fed475a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Deleted volume successfully. Apr 29 09:14:31 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Volume volume-04b2713d-98ab-4bde-b39b-c467e8b11696 (04b2713d-98ab-4bde-b39b-c467e8b11696): created successfully Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58377fb-4267-49fa-928c-0e86fed475a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (acf9f8e0-631d-4da5-8b0c-4986ff4ac5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-adf85484-53c3-4934-97ee-109aa0b329e6 tempest-VolumesGetTest-985433763 None] Lock "cinder-671a8475-516a-470b-a505-72caca81f456-delete_volume" released by "delete_volume" :: held 4.797s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-899055cf-5bf9-4eaf-841e-998e82941aea tempest-VolumeDependencyTests-2110022883 None] Created volume successfully. Apr 29 09:14:31 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 Apr 29 09:14:31 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-1690ced7-3706-4eef-8029-4a522b879345-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-1690ced7-3706-4eef-8029-4a522b879345-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-c24238f2-ff8c-48d3-8502-711cd3001ac6" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-c24238f2-ff8c-48d3-8502-711cd3001ac6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-1690ced7-3706-4eef-8029-4a522b879345" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-1690ced7-3706-4eef-8029-4a522b879345" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Deleting offline snapshot 1690ced7-3706-4eef-8029-4a522b879345 of volume c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] snapshot_file for this snap is: volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb9c06-3d39-425f-9632-1fd37c80eb31]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:31 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 Apr 29 09:14:31 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:31 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39" returned: 0 in 0.785s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:31 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc 1G Apr 29 09:14:31 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:32 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345" returned: 0 in 0.763s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c24238f2-ff8c-48d3-8502-711cd3001ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:14:32 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4b119a-a1a2-4207-a646-0efb7980951f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:32 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 Apr 29 09:14:32 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:32 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc 1G" returned: 0 in 0.917s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:32 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc Apr 29 09:14:32 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:33 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6" returned: 0 in 0.744s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:33 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 Apr 29 09:14:33 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:33 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc" returned: 0 in 0.687s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:33 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc is being set with open permissions: ugo+rw Apr 29 09:14:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:33 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc Apr 29 09:14:33 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:34 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Flow 'volume_create_manager' (59316b20-c215-49c6-93ec-e7259c236ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9552a3dc-5fd7-4776-96e7-f1eb9f69416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345" returned: 0 in 0.803s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9552a3dc-5fd7-4776-96e7-f1eb9f69416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-76527950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4772b41-ce05-487a-849b-3d5eb0aed3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f9dbecf3f324e418b8ff323c7fb158e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:34Z,use_quota=True,user_id='8d04d1c2c32943b19cced4363e1321c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:34 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345 Apr 29 09:14:34 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eb9ef2-3be0-481c-aa31-06a449dd8ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eb9ef2-3be0-481c-aa31-06a449dd8ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:34 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1e8772-7e45-41a9-ba62-14dd49c485ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1e8772-7e45-41a9-ba62-14dd49c485ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4772b41-ce05-487a-849b-3d5eb0aed3e0', 'volume_name': 'volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85097880-f759-4018-a628-3a33fcf69d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85097880-f759-4018-a628-3a33fcf69d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c413424-d4d1-41b6-8554-d3bf8c4eeebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:34 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Volume a4772b41-ce05-487a-849b-3d5eb0aed3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0', 'volume_size': 1} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc" returned: 0 in 0.663s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:34 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.info Apr 29 09:14:34 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:34 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6.1690ced7-3706-4eef-8029-4a522b879345" returned: 0 in 0.638s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:34 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.info" returned: 0 in 0.575s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:34 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.info is being set with open permissions: ugo+rw Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-1690ced7-3706-4eef-8029-4a522b879345" released by "_delete_snapshot" :: held 3.077s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-c24238f2-ff8c-48d3-8502-711cd3001ac6" released by "delete_snapshot" :: held 3.114s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:34 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.info Apr 29 09:14:34 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Created reservations ['c13e12a1-6eab-4c56-9584-0f5fb5180580', 'e90572df-f3c6-4fb1-a336-e0d56f8efbe5', 'ac5b499c-a293-4c59-9339-bfeafd731b4b', '797824ea-953b-4f22-8b2e-b83d16b080d7'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:34 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Delete snapshot completed successfully. Apr 29 09:14:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-e995e389-a854-46fc-85ce-981c0ab0912a tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-1690ced7-3706-4eef-8029-4a522b879345-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:35 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.info" returned: 0 in 0.575s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.310s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-76527950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4772b41-ce05-487a-849b-3d5eb0aed3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f9dbecf3f324e418b8ff323c7fb158e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:34Z,use_quota=True,user_id='8d04d1c2c32943b19cced4363e1321c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Creating volume a4772b41-ce05-487a-849b-3d5eb0aed3e0 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:35 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:35 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 1073741824 Apr 29 09:14:35 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:35 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-733f4882-9165-443b-8659-42345d2c0ef6 tempest-VolumesExtendTest-1620159938 None] Create snapshot completed successfully Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-c24238f2-ff8c-48d3-8502-711cd3001ac6-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-c24238f2-ff8c-48d3-8502-711cd3001ac6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-c24238f2-ff8c-48d3-8502-711cd3001ac6" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-c24238f2-ff8c-48d3-8502-711cd3001ac6" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:35 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95fc44c-de30-4107-a739-12d41bb9c09c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:36 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 Apr 29 09:14:36 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:36 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 1073741824" returned: 0 in 0.785s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:36 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 Apr 29 09:14:36 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:36 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6" returned: 0 in 0.714s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:36 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6 Apr 29 09:14:36 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:36 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0" returned: 0 in 0.589s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.060s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c413424-d4d1-41b6-8554-d3bf8c4eeebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478689e9-a01c-4c93-963f-8aeff7fe8d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fcae4d-8bed-4b29-8fca-2f2a817f9d4d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:36 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Volume volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 (a4772b41-ce05-487a-849b-3d5eb0aed3e0): created successfully Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478689e9-a01c-4c93-963f-8aeff7fe8d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Flow 'volume_create_manager' (59316b20-c215-49c6-93ec-e7259c236ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e159e7ea-c443-41ed-aa28-ba0f94f539b2 tempest-VolumesNegativeTest-1041125406 None] Created volume successfully. Apr 29 09:14:36 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 Apr 29 09:14:36 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:37 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c24238f2-ff8c-48d3-8502-711cd3001ac6" returned: 0 in 0.627s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-c24238f2-ff8c-48d3-8502-711cd3001ac6" released by "delete_volume" :: held 1.409s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Created reservations ['cbb1d0db-2fbf-4aa6-9dae-36b4b33cf3a4', '32e703f3-bcf1-4bc4-8a61-ee7a91d8308d', 'afb1ee0f-c1df-48c0-b475-c686a6d51cbe', 'eca1fcf8-62e6-4398-966d-b90ade85957a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:37 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:37 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39" returned: 0 in 0.784s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:37 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc 2G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc 2G" returned: 0 in 0.146s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.986s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-bcf4c7e5-a2e0-44de-a17f-8f92f5f0a09f tempest-VolumesExtendTest-1620159938 None] Extend volume completed successfully. Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Acquiring lock "cinder-493acbb0-a234-4215-bca2-dc34292e67dc-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Lock "cinder-493acbb0-a234-4215-bca2-dc34292e67dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Acquiring lock "cinder-quobyte-8795ecb6-26db-4ad2-b249-97637fbc7b39" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-8795ecb6-26db-4ad2-b249-97637fbc7b39" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Acquiring lock "cinder-quobyte-493acbb0-a234-4215-bca2-dc34292e67dc" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-493acbb0-a234-4215-bca2-dc34292e67dc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Deleting offline snapshot 493acbb0-a234-4215-bca2-dc34292e67dc of volume 8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] snapshot_file for this snap is: volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd66fe-342a-451e-aae5-629bce363c60]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:38 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.640s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:38 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Deleted volume successfully. Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84478ae5-44a6-4202-bf7a-2795dd2f76f0 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-c24238f2-ff8c-48d3-8502-711cd3001ac6-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:38 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc Apr 29 09:14:38 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (8b27a4b8-d91b-4a81-9a1e-b0e8325ac7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddfcd68-fe54-4b02-86db-99dde4a1c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddfcd68-fe54-4b02-86db-99dde4a1c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2027731972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3412d32-2e1d-4012-802e-ed4d9df56823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe56e1b05eb940b08694e5211dbc6975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:39Z,use_quota=True,user_id='361c94b225a44bf6b74b172e3133c338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13853e22-dd09-4103-8b65-dc54a519770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13853e22-dd09-4103-8b65-dc54a519770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72daa64c-9d1c-4c72-bfab-8ff8e5dd6e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72daa64c-9d1c-4c72-bfab-8ff8e5dd6e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3412d32-2e1d-4012-802e-ed4d9df56823', 'volume_name': 'volume-c3412d32-2e1d-4012-802e-ed4d9df56823', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fffd167-9c66-4f32-8fd1-1a760788c095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fffd167-9c66-4f32-8fd1-1a760788c095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea3e723-c92a-482e-91fe-7d0c8fb24782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:38 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Volume c3412d32-2e1d-4012-802e-ed4d9df56823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3412d32-2e1d-4012-802e-ed4d9df56823', 'volume_size': 1} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2027731972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3412d32-2e1d-4012-802e-ed4d9df56823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe56e1b05eb940b08694e5211dbc6975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:39Z,use_quota=True,user_id='361c94b225a44bf6b74b172e3133c338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Creating volume c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:38 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:38 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 1073741824 Apr 29 09:14:38 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:39 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc" returned: 0 in 0.837s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8795ecb6-26db-4ad2-b249-97637fbc7b39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[95604f89-abc5-46ec-b507-033a43efaa11]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:39 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 Apr 29 09:14:39 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:39 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 1073741824" returned: 0 in 0.796s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:39 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 Apr 29 09:14:39 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:39 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39" returned: 0 in 0.741s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:39 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc Apr 29 09:14:39 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:40 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823" returned: 0 in 0.637s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea3e723-c92a-482e-91fe-7d0c8fb24782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3412d32-2e1d-4012-802e-ed4d9df56823', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459e3b85-477f-4bf6-9f74-60ef1831f08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:40 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Volume volume-c3412d32-2e1d-4012-802e-ed4d9df56823 (c3412d32-2e1d-4012-802e-ed4d9df56823): created successfully Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459e3b85-477f-4bf6-9f74-60ef1831f08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (8b27a4b8-d91b-4a81-9a1e-b0e8325ac7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:40 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-21bd293b-cc1e-4f5d-9aff-3e73617f8b6e tempest-VolumeDependencyTests-2110022883 None] Created volume successfully. Apr 29 09:14:40 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc" returned: 0 in 0.690s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:40 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc Apr 29 09:14:40 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:41 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39.493acbb0-a234-4215-bca2-dc34292e67dc" returned: 0 in 0.640s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-493acbb0-a234-4215-bca2-dc34292e67dc" released by "_delete_snapshot" :: held 3.062s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-8795ecb6-26db-4ad2-b249-97637fbc7b39" released by "delete_snapshot" :: held 3.101s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (17851e7d-728e-4751-a47e-b9d7d8bb0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ef474b-80d8-4400-ba29-8b71a8cb5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ef474b-80d8-4400-ba29-8b71a8cb5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-94279766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e50feb-dc13-4502-aff6-29007f45c4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe56e1b05eb940b08694e5211dbc6975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c3412d32-2e1d-4012-802e-ed4d9df56823,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:41Z,use_quota=True,user_id='361c94b225a44bf6b74b172e3133c338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2644e08-a485-4c61-9bc9-cb544fc6dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2644e08-a485-4c61-9bc9-cb544fc6dc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b461611c-1b46-4130-b04d-4cd68eef2a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b461611c-1b46-4130-b04d-4cd68eef2a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e3e50feb-dc13-4502-aff6-29007f45c4a5', 'volume_name': 'volume-e3e50feb-dc13-4502-aff6-29007f45c4a5', 'volume_size': 1, 'source_volid': 'c3412d32-2e1d-4012-802e-ed4d9df56823', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ff3550-81bb-477d-99ca-9067d67d2005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ff3550-81bb-477d-99ca-9067d67d2005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad26f5bf-d08d-4bb9-bbc5-b61179d90b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:41 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Volume e3e50feb-dc13-4502-aff6-29007f45c4a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e3e50feb-dc13-4502-aff6-29007f45c4a5', 'volume_size': 1, 'source_volid': 'c3412d32-2e1d-4012-802e-ed4d9df56823', 'source_volstatus': 'available'} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Created reservations ['b1653dfc-9ada-4d56-9b1f-5ad647d9f917', '76524bea-9e0c-4aa5-8ea5-778feb6470fa', '8de40462-f390-44c0-90c3-61d32edfc520', '74dc1971-b064-4f13-9ee0-7de08de66089'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:41 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Cloning volume c3412d32-2e1d-4012-802e-ed4d9df56823 to volume e3e50feb-dc13-4502-aff6-29007f45c4a5 Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Creating offline snapshot 4ee84fc5-02ed-41c7-aaa6-9448904b8004 of volume c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cc7399-584f-473f-9b86-fedbe2ccc6b6]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:41 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Delete snapshot completed successfully. Apr 29 09:14:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d2c76aa3-04ea-440a-be18-f4ce48fe581f tempest-VolumesExtendTest-1620159938 None] Lock "cinder-493acbb0-a234-4215-bca2-dc34292e67dc-delete_snapshot" released by "delete_snapshot" :: held 3.411s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:41 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 Apr 29 09:14:41 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:42 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823" returned: 0 in 0.689s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:42 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 1G Apr 29 09:14:42 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Acquiring lock "cinder-8795ecb6-26db-4ad2-b249-97637fbc7b39-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Lock "cinder-8795ecb6-26db-4ad2-b249-97637fbc7b39-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Acquiring lock "cinder-quobyte-8795ecb6-26db-4ad2-b249-97637fbc7b39" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-8795ecb6-26db-4ad2-b249-97637fbc7b39" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[95331b60-d0d4-4d96-bd4c-70bea7237e0c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:42 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 Apr 29 09:14:42 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:42 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 1G" returned: 0 in 0.770s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3412d32-2e1d-4012-802e-ed4d9df56823 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:42 devstack sudo[91829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3412d32-2e1d-4012-802e-ed4d9df56823 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 Apr 29 09:14:42 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:43 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39" returned: 0 in 0.790s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:43 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39 Apr 29 09:14:43 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:43 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3412d32-2e1d-4012-802e-ed4d9df56823 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004" returned: 0 in 0.781s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:43 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 is being set with open permissions: ugo+rw Apr 29 09:14:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:43 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 Apr 29 09:14:43 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:43 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8795ecb6-26db-4ad2-b249-97637fbc7b39" returned: 0 in 0.614s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:43 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Lock "cinder-quobyte-8795ecb6-26db-4ad2-b249-97637fbc7b39" released by "delete_volume" :: held 1.468s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:43 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Created reservations ['9c45e783-7a4f-4d42-a4ad-e3c66585edd2', '6d28380d-0339-4ad0-b204-20d1b9a941bc', '0e83d883-9f97-4618-8aac-024dce9c390e', '42f05906-76ff-4368-be29-0626068d855e'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:44 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:14:44 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:44 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004" returned: 0 in 0.791s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:44 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.info Apr 29 09:14:44 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:44 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.863s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:45 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:14:45 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Deleted volume successfully. Apr 29 09:14:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-38211687-1d41-4ba4-8aed-436570e12d5d tempest-VolumesExtendTest-1620159938 None] Lock "cinder-8795ecb6-26db-4ad2-b249-97637fbc7b39-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:45 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.info" returned: 0 in 0.782s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:45 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.info is being set with open permissions: ugo+rw Apr 29 09:14:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:45 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.info Apr 29 09:14:45 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:46 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.info" returned: 0 in 0.716s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-e3e50feb-dc13-4502-aff6-29007f45c4a5" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-e3e50feb-dc13-4502-aff6-29007f45c4a5" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] snapshot: 4ee84fc5-02ed-41c7-aaa6-9448904b8004, volume: e3e50feb-dc13-4502-aff6-29007f45c4a5, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b64a477-1ac5-4984-9079-8e73c6b838d3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:46 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 Apr 29 09:14:46 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:46 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004" returned: 0 in 0.813s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3412d32-2e1d-4012-802e-ed4d9df56823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8502d67-5bde-430f-ad13-4660f1192055]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:47 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 Apr 29 09:14:47 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Flow 'volume_create_manager' (7d454f04-be25-4329-b161-9f8713b5236f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd3ea73-b0c8-4029-8fe3-8d4847161e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd3ea73-b0c8-4029-8fe3-8d4847161e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-270490182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1410b681-90b5-45d0-b3a3-0b23f76826b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347bb7baab42457dbfa26b8c5cca4fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:48Z,use_quota=True,user_id='c8308b3f232c4baaa35e52540826cea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beaf9b02-1080-40d6-96ad-aa0b2d3291d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beaf9b02-1080-40d6-96ad-aa0b2d3291d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:47 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f0a487-302c-4bb2-84bd-237542ebc2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f0a487-302c-4bb2-84bd-237542ebc2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1410b681-90b5-45d0-b3a3-0b23f76826b2', 'volume_name': 'volume-1410b681-90b5-45d0-b3a3-0b23f76826b2', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d410a2e-2f71-4919-8ba3-83f4e226a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d410a2e-2f71-4919-8ba3-83f4e226a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964c9b32-1d57-4e1c-9166-73d458ea1f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:47 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Volume 1410b681-90b5-45d0-b3a3-0b23f76826b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1410b681-90b5-45d0-b3a3-0b23f76826b2', 'volume_size': 1} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823" returned: 0 in 0.838s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:14:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:47 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 Apr 29 09:14:47 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:53 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5" returned: 0 in 5.830s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:53 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[7532e02a-1d12-4eb4-a24a-1a334f7e37be]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:53 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 Apr 29 09:14:53 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:54 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823" returned: 0 in 0.954s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:54 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:14:54 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Converted 1024.00 MB image at 175.57 MB/s Apr 29 09:14:54 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 is being set with open permissions: ugo+rw Apr 29 09:14:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:54 devstack sudo[92008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 Apr 29 09:14:54 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:55 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5" returned: 0 in 0.619s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-e3e50feb-dc13-4502-aff6-29007f45c4a5" released by "_copy_volume_from_snapshot" :: held 9.179s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=188,cinder:SELECT=138,cinder:DELETE=19,cinder:INSERT=61 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-4ee84fc5-02ed-41c7-aaa6-9448904b8004" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-4ee84fc5-02ed-41c7-aaa6-9448904b8004" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Deleting offline snapshot 4ee84fc5-02ed-41c7-aaa6-9448904b8004 of volume c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] snapshot_file for this snap is: volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a38a53-2f5f-40dd-9457-befd43d1413d]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:55 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 Apr 29 09:14:55 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:56 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004" returned: 0 in 0.801s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3412d32-2e1d-4012-802e-ed4d9df56823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:14:56 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d89956-d883-4adb-94e5-46704f7d54b3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:56 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 Apr 29 09:14:56 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:56 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823" returned: 0 in 0.704s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:56 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 Apr 29 09:14:56 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:57 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004" returned: 0 in 0.786s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:57 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004 Apr 29 09:14:57 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:57 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:INSERT=41,cinder:UPDATE=132,cinder:SELECT=108,cinder:DELETE=7 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:14:58 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823.4ee84fc5-02ed-41c7-aaa6-9448904b8004" returned: 0 in 0.615s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-4ee84fc5-02ed-41c7-aaa6-9448904b8004" released by "_delete_snapshot" :: held 3.007s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.957s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.529s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-270490182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1410b681-90b5-45d0-b3a3-0b23f76826b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347bb7baab42457dbfa26b8c5cca4fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:48Z,use_quota=True,user_id='c8308b3f232c4baaa35e52540826cea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Creating volume 1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:14:58 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad26f5bf-d08d-4bb9-bbc5-b61179d90b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e50feb-dc13-4502-aff6-29007f45c4a5', 'volume_size': 1, 'source_volid': 'c3412d32-2e1d-4012-802e-ed4d9df56823', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:58 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 1073741824 Apr 29 09:14:58 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfad6728-1d97-4822-98e9-81540abe880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Volume volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 (e3e50feb-dc13-4502-aff6-29007f45c4a5): created successfully Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfad6728-1d97-4822-98e9-81540abe880d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Flow 'volume_create_manager' (17851e7d-728e-4751-a47e-b9d7d8bb0567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0aa91cdf-4d36-404c-bcd4-c0c55be88418 tempest-VolumeDependencyTests-2110022883 None] Created volume successfully. Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-c3412d32-2e1d-4012-802e-ed4d9df56823-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-c3412d32-2e1d-4012-802e-ed4d9df56823-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-c3412d32-2e1d-4012-802e-ed4d9df56823" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-c3412d32-2e1d-4012-802e-ed4d9df56823" acquired by "delete_volume" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed33017-012e-4427-bb09-b931b3da0fbc]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:14:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:59 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 Apr 29 09:14:59 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:59 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 1073741824" returned: 0 in 0.808s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:59 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 Apr 29 09:14:59 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:59 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823" returned: 0 in 0.769s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:14:59 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823 Apr 29 09:14:59 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:14:59 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2" returned: 0 in 0.603s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964c9b32-1d57-4e1c-9166-73d458ea1f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1410b681-90b5-45d0-b3a3-0b23f76826b2', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b22da4-a0cf-41b4-9c92-4dd7bfde7cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:14:59 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Volume volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 (1410b681-90b5-45d0-b3a3-0b23f76826b2): created successfully Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b22da4-a0cf-41b4-9c92-4dd7bfde7cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:14:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Flow 'volume_create_manager' (7d454f04-be25-4329-b161-9f8713b5236f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:14:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1bc1174a-7a1a-4c1a-a053-336747c65847 tempest-VolumesSnapshotListTestJSON-488714799 None] Created volume successfully. Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Creating offline snapshot df82580c-407b-44a1-9daa-df17dca140a4 of volume 1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe356ce-e1f7-4d72-8aa4-59fb0f5a6afc]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:00 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 Apr 29 09:15:00 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:00 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-c3412d32-2e1d-4012-802e-ed4d9df56823" returned: 0 in 0.691s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-c3412d32-2e1d-4012-802e-ed4d9df56823" released by "delete_volume" :: held 1.515s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Created reservations ['9d634b7d-6cd4-41c5-9fff-5e183d5de3f3', '22860d4e-ad7c-4998-8454-3fa76978d72c', 'f7002d2a-8c89-4b97-a58a-2313bee1b1b8', 'e0712c71-72b0-4e29-ac09-a587d6a3af9c'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:00 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:00 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:01 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2" returned: 0 in 0.819s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-e3e50feb-dc13-4502-aff6-29007f45c4a5-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:01 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 1G Apr 29 09:15:01 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-e3e50feb-dc13-4502-aff6-29007f45c4a5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-e3e50feb-dc13-4502-aff6-29007f45c4a5" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-e3e50feb-dc13-4502-aff6-29007f45c4a5" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:01 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.687s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Deleted volume successfully. Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7098c8-b5d9-42a4-9953-dbcce13b125b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-182af7a1-8f8b-4777-b0bd-9da19b145aed tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-c3412d32-2e1d-4012-802e-ed4d9df56823-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:01 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 Apr 29 09:15:01 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:01 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 1G" returned: 0 in 0.830s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:01 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 Apr 29 09:15:01 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:02 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5" returned: 0 in 0.803s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:02 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5 Apr 29 09:15:02 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:02 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:02 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:02 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4" returned: 0 in 0.680s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:02 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 is being set with open permissions: ugo+rw Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:02 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 Apr 29 09:15:02 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:02 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e3e50feb-dc13-4502-aff6-29007f45c4a5" returned: 0 in 0.676s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-e3e50feb-dc13-4502-aff6-29007f45c4a5" released by "delete_volume" :: held 1.541s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Created reservations ['0a7d733e-0dfb-44db-b6a4-c444595e7046', '49729144-fc2f-45b2-97a6-cffaae916ce6', '3aeaf1ab-60d4-4ee9-9d5a-99ce64773eed', 'c918fb2e-e4d4-468c-8d63-0a00427f56d7'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:02 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:02 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:03 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.665s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:03 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4" returned: 0 in 0.648s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:03 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.info Apr 29 09:15:03 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-04b2713d-98ab-4bde-b39b-c467e8b11696-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-04b2713d-98ab-4bde-b39b-c467e8b11696-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "cinder-quobyte-04b2713d-98ab-4bde-b39b-c467e8b11696" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-04b2713d-98ab-4bde-b39b-c467e8b11696" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e3e562-cab0-4558-9491-0e3691abcbd6]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:03 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.732s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:03 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Deleted volume successfully. Apr 29 09:15:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b23540b7-725a-4743-a63d-024e92064a1b tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-e3e50feb-dc13-4502-aff6-29007f45c4a5-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:03 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 Apr 29 09:15:03 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:04 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.info" returned: 0 in 0.715s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:04 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.info is being set with open permissions: ugo+rw Apr 29 09:15:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:04 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.info Apr 29 09:15:04 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:04 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696" returned: 0 in 0.733s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:04 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696 Apr 29 09:15:04 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:04 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.info" returned: 0 in 0.640s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.435s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-793f7c97-2492-4d65-ab95-f11f80721414 tempest-VolumesSnapshotListTestJSON-488714799 None] Create snapshot completed successfully Apr 29 09:15:04 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-04b2713d-98ab-4bde-b39b-c467e8b11696" returned: 0 in 0.622s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-quobyte-04b2713d-98ab-4bde-b39b-c467e8b11696" released by "delete_volume" :: held 1.407s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Created reservations ['94b3fbf6-bfa8-49a8-a077-b80b0ccaec22', '9a5a70af-ec13-49a4-8cc8-ce24a366482a', 'b2144179-67e4-45cc-b4bd-9db591c57838', 'e9f1c38e-285e-4091-b235-49c4fbd534f5'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:05 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:05 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Creating offline snapshot 2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc of volume 1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:15:05 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.662s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Deleted volume successfully. Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c7d43b-00b2-416b-9b23-99c00469751f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-a3f04868-4f66-4184-a008-7e99e208f6bf tempest-VolumeDependencyTests-2110022883 None] Lock "cinder-04b2713d-98ab-4bde-b39b-c467e8b11696-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:05 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 Apr 29 09:15:05 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:06 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4" returned: 0 in 0.800s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1410b681-90b5-45d0-b3a3-0b23f76826b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:06 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc 1G Apr 29 09:15:06 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:07 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc 1G" returned: 0 in 0.992s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:07 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc Apr 29 09:15:07 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Acquiring lock "cinder-a4772b41-ce05-487a-849b-3d5eb0aed3e0-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Lock "cinder-a4772b41-ce05-487a-849b-3d5eb0aed3e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Acquiring lock "cinder-quobyte-a4772b41-ce05-487a-849b-3d5eb0aed3e0" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Lock "cinder-quobyte-a4772b41-ce05-487a-849b-3d5eb0aed3e0" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd67de7-1989-4717-86fd-6c390d173232]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:07 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 Apr 29 09:15:07 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:08 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" returned: 0 in 0.706s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:08 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc is being set with open permissions: ugo+rw Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:08 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc Apr 29 09:15:08 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:08 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0" returned: 0 in 0.732s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:08 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0 Apr 29 09:15:08 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:08 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Flow 'volume_create_manager' (2d43192c-af26-464a-9a90-736aef360557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a7977d-34e3-4ab8-955d-7aeeef7e8bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" returned: 0 in 0.692s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a7977d-34e3-4ab8-955d-7aeeef7e8bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278fe30d-5b72-4038-82ec-90533dd2c11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e790e553cd974d96900631af89374c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:09Z,use_quota=True,user_id='f00fa9aea71e49f8a2526b7d09728eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7bbe0d-c770-455c-a113-7a9b27a08c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7bbe0d-c770-455c-a113-7a9b27a08c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73496bcc-f558-4cf9-82ec-2a67db593280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73496bcc-f558-4cf9-82ec-2a67db593280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278fe30d-5b72-4038-82ec-90533dd2c11e', 'volume_name': 'volume-278fe30d-5b72-4038-82ec-90533dd2c11e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab48700-3e48-44a2-a811-0cbc37203d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab48700-3e48-44a2-a811-0cbc37203d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e34f18-3b5f-444c-958b-e194fe0fde70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:09 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Volume 278fe30d-5b72-4038-82ec-90533dd2c11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278fe30d-5b72-4038-82ec-90533dd2c11e', 'volume_size': 1} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278fe30d-5b72-4038-82ec-90533dd2c11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e790e553cd974d96900631af89374c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:09Z,use_quota=True,user_id='f00fa9aea71e49f8a2526b7d09728eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Creating volume 278fe30d-5b72-4038-82ec-90533dd2c11e {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:09 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:09 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e 1073741824 Apr 29 09:15:09 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:09 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-6cc0e149-4a04-47d0-83d8-c486f9db1a99 tempest-VolumesSnapshotListTestJSON-488714799 None] Create snapshot completed successfully Apr 29 09:15:09 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a4772b41-ce05-487a-849b-3d5eb0aed3e0" returned: 0 in 0.687s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Lock "cinder-quobyte-a4772b41-ce05-487a-849b-3d5eb0aed3e0" released by "delete_volume" :: held 1.469s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Created reservations ['05b95e22-5f97-4477-b4d2-2f21313967d3', 'e37ce1ab-609c-4d32-be6a-ecdb4a60ff93', '4c64639d-b7c6-49c8-86e3-ba6218c93f29', '4b59d1fc-3292-4889-aa64-cc114b12d8bf'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:09 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:09 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:09 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e 1073741824" returned: 0 in 0.783s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:09 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e Apr 29 09:15:09 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:10 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.680s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Deleted volume successfully. Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2660e032-1e07-4c5b-8110-4598b740eac6 tempest-VolumesNegativeTest-1041125406 None] Lock "cinder-a4772b41-ce05-487a-849b-3d5eb0aed3e0-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:10 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e" returned: 0 in 0.697s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.442s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e34f18-3b5f-444c-958b-e194fe0fde70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278fe30d-5b72-4038-82ec-90533dd2c11e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6a70d6-c376-4056-838d-4bd052114e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Creating offline snapshot e41e48e2-8410-42f9-907e-87f3c29b6280 of volume 1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:15:10 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Volume volume-278fe30d-5b72-4038-82ec-90533dd2c11e (278fe30d-5b72-4038-82ec-90533dd2c11e): created successfully Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6a70d6-c376-4056-838d-4bd052114e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Flow 'volume_create_manager' (2d43192c-af26-464a-9a90-736aef360557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd838033-2d93-4676-bd50-8b0fd1c06cd2]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2f447209-9b0d-434b-a223-641c3a794f88 tempest-CinderUnicodeTest-878983989 None] Created volume successfully. Apr 29 09:15:10 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc Apr 29 09:15:10 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:11 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" returned: 0 in 0.759s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1410b681-90b5-45d0-b3a3-0b23f76826b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:11 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 1G Apr 29 09:15:11 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Flow 'volume_create_manager' (2a630b12-c5f7-4b7e-95c7-6c0edfcf9e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d2e916-86b7-4e29-a925-df9854ea0953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d2e916-86b7-4e29-a925-df9854ea0953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1917129429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fea0b94-9d11-46b1-ae12-55cde09e7395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e790e553cd974d96900631af89374c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='f00fa9aea71e49f8a2526b7d09728eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9519fcf1-1d68-46af-bb2c-30006ce4574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9519fcf1-1d68-46af-bb2c-30006ce4574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e346ee-c7cb-4934-a223-faeefdff4730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e346ee-c7cb-4934-a223-faeefdff4730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fea0b94-9d11-46b1-ae12-55cde09e7395', 'volume_name': 'volume-9fea0b94-9d11-46b1-ae12-55cde09e7395', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dc4756-3aac-4362-b82c-20693aeccf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dc4756-3aac-4362-b82c-20693aeccf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d1bba0-9085-4e33-af3c-bc380b5b9614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:11 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Volume 9fea0b94-9d11-46b1-ae12-55cde09e7395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fea0b94-9d11-46b1-ae12-55cde09e7395', 'volume_size': 1} Apr 29 09:15:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (b033f17b-4fb1-4fac-bed4-4d28589b8356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe730fb-4161-49c4-856f-f66f4b9fa8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe730fb-4161-49c4-856f-f66f4b9fa8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1168678370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5874ceb9-d1a7-4741-9690-0cada09d8c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c397cde-df38-473e-b8be-c36c86e45686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c397cde-df38-473e-b8be-c36c86e45686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c5a2e8-f6ef-487d-adbd-0b1ae5849c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c5a2e8-f6ef-487d-adbd-0b1ae5849c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5874ceb9-d1a7-4741-9690-0cada09d8c0b', 'volume_name': 'volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad39e01-5aec-4092-88f4-2e1010fedc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad39e01-5aec-4092-88f4-2e1010fedc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41975790-31e4-47a4-9803-fce00ce9bd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:12 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume 5874ceb9-d1a7-4741-9690-0cada09d8c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b', 'volume_size': 1} Apr 29 09:15:12 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 1G" returned: 0 in 0.992s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:12 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 Apr 29 09:15:12 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:13 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280" returned: 0 in 0.632s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:13 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 is being set with open permissions: ugo+rw Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:13 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 Apr 29 09:15:13 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:13 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280" returned: 0 in 0.567s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.086s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1917129429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fea0b94-9d11-46b1-ae12-55cde09e7395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e790e553cd974d96900631af89374c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='f00fa9aea71e49f8a2526b7d09728eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Creating volume 9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:13 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:13 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 1073741824 Apr 29 09:15:13 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8dd226d6-6320-4b3b-a462-d5115a69a2f5 tempest-VolumesSnapshotListTestJSON-488714799 None] Create snapshot completed successfully Apr 29 09:15:14 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 1073741824" returned: 0 in 0.759s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:14 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 Apr 29 09:15:14 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:15 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395" returned: 0 in 0.588s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.628s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1168678370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5874ceb9-d1a7-4741-9690-0cada09d8c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Creating volume 5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:15 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-e41e48e2-8410-42f9-907e-87f3c29b6280-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:15 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b 1073741824 Apr 29 09:15:15 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d1bba0-9085-4e33-af3c-bc380b5b9614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fea0b94-9d11-46b1-ae12-55cde09e7395', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17855f4-1bf7-452c-8a12-ff23e0472abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-e41e48e2-8410-42f9-907e-87f3c29b6280-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:15 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Volume volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 (9fea0b94-9d11-46b1-ae12-55cde09e7395): created successfully Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17855f4-1bf7-452c-8a12-ff23e0472abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Flow 'volume_create_manager' (2a630b12-c5f7-4b7e-95c7-6c0edfcf9e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-quobyte-e41e48e2-8410-42f9-907e-87f3c29b6280" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:15 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7a0950ce-5b5c-45d4-8a93-8ab47d90974f tempest-CinderUnicodeTest-878983989 None] Created volume successfully. Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-e41e48e2-8410-42f9-907e-87f3c29b6280" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Deleting offline snapshot e41e48e2-8410-42f9-907e-87f3c29b6280 of volume 1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] snapshot_file for this snap is: volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36a9322-1c70-44ef-b84a-3a4bb22c4cd0]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:15 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 Apr 29 09:15:15 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:15 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b 1073741824" returned: 0 in 0.750s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:15 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b Apr 29 09:15:15 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:15 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280" returned: 0 in 0.738s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1410b681-90b5-45d0-b3a3-0b23f76826b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217d713-d989-4948-8ea5-77a4408b164b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:16 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc Apr 29 09:15:16 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:16 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b" returned: 0 in 0.607s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.317s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41975790-31e4-47a4-9803-fce00ce9bd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4ed9fd-0cce-439d-ae87-259462fd73a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Creating offline snapshot a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c of volume 9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:15:16 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b (5874ceb9-d1a7-4741-9690-0cada09d8c0b): created successfully Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4ed9fd-0cce-439d-ae87-259462fd73a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (b033f17b-4fb1-4fac-bed4-4d28589b8356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a248ad4b-c032-462e-9478-aa5aaf21d3b4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:16 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-ed3c1dba-b635-46e5-af11-936174488261 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created volume successfully. Apr 29 09:15:16 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 Apr 29 09:15:16 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:16 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" returned: 0 in 0.714s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1410b681-90b5-45d0-b3a3-0b23f76826b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:16 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 Apr 29 09:15:16 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:17 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395" returned: 0 in 0.761s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:17 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c 1G Apr 29 09:15:17 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:17 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280" returned: 0 in 0.765s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:17 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280 Apr 29 09:15:17 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:18 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.e41e48e2-8410-42f9-907e-87f3c29b6280" returned: 0 in 0.623s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-e41e48e2-8410-42f9-907e-87f3c29b6280" released by "_delete_snapshot" :: held 2.951s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" released by "delete_snapshot" :: held 2.976s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:18 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c 1G" returned: 0 in 0.839s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:18 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c Apr 29 09:15:18 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Created reservations ['2294aaf7-0c1e-48c6-97f5-8b52bd81cc15', 'e83fe778-258a-49cc-a5e9-bd5e1e90d2d3', '95e5ceea-77e4-4636-90fe-b4a3683a3da3', 'dc56a2eb-ea0e-408e-b7ec-c01d41f45223'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:18 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Delete snapshot completed successfully. Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-763c9da2-4f1e-447d-88bf-10123af8c193 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-e41e48e2-8410-42f9-907e-87f3c29b6280-delete_snapshot" released by "delete_snapshot" :: held 3.144s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:18 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" returned: 0 in 0.729s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:18 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c is being set with open permissions: ugo+rw Apr 29 09:15:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:18 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c Apr 29 09:15:18 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-quobyte-2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Deleting offline snapshot 2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc of volume 1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] snapshot_file for this snap is: volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd43acd-4f80-4659-80cb-ca3a542d8b83]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:19 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" returned: 0 in 0.606s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:19 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc Apr 29 09:15:19 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:19 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.info Apr 29 09:15:19 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:20 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:20 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" returned: 0 in 0.694s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.info" returned: 0 in 0.593s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1410b681-90b5-45d0-b3a3-0b23f76826b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:20 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.info is being set with open permissions: ugo+rw Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dbe024-a0b4-441e-b4d2-5825d81c5456]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:20 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.info Apr 29 09:15:20 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:20 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 Apr 29 09:15:20 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:20 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.info" returned: 0 in 0.584s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.864s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Creating offline snapshot 318f64f4-8696-4de2-af5b-982c62622a9b of volume 5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:15:20 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-58660925-3de3-4a56-a250-4050f5c738b8 tempest-CinderUnicodeTest-878983989 None] Create snapshot completed successfully Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2ab86d-4123-413c-a1ab-25f096b2120f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:20 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4" returned: 0 in 0.679s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1410b681-90b5-45d0-b3a3-0b23f76826b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:20 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:20 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc Apr 29 09:15:20 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:20 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b Apr 29 09:15:20 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Acquiring lock "cinder-a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Lock "cinder-a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Acquiring lock "cinder-quobyte-9fea0b94-9d11-46b1-ae12-55cde09e7395" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-9fea0b94-9d11-46b1-ae12-55cde09e7395" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Acquiring lock "cinder-quobyte-a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Deleting offline snapshot a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c of volume 9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:15:21 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] snapshot_file for this snap is: volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b" returned: 0 in 0.734s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4484b5f-21db-4afc-979e-003450f45358]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:21 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b 1G Apr 29 09:15:21 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:21 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" returned: 0 in 0.776s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:21 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:21 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc Apr 29 09:15:21 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:21 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c Apr 29 09:15:21 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:22 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" returned: 0 in 0.589s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc" released by "_delete_snapshot" :: held 2.840s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" released by "delete_snapshot" :: held 2.863s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Created reservations ['da9a8ea6-b04b-4e89-af8e-8495fc4ccf5e', '1e2fd17c-92e0-4569-a458-284d7c1ad59c', '97dfdd87-d7df-47d9-b241-e991d3606141', '9f49f805-43b4-4c73-86df-f397d5b643d8'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:22 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b 1G" returned: 0 in 0.792s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:22 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" returned: 0 in 0.789s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fea0b94-9d11-46b1-ae12-55cde09e7395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:22 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b Apr 29 09:15:22 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[92429756-1f22-4b07-8a9c-691e5d28248e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:22 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Delete snapshot completed successfully. Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-26465e63-a7d1-4435-a22f-817c4f5c9bab tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-2b72825b-3b81-4d5f-ad9f-e3f7ba8b3ecc-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:22 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 Apr 29 09:15:22 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-df82580c-407b-44a1-9daa-df17dca140a4-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-df82580c-407b-44a1-9daa-df17dca140a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-quobyte-df82580c-407b-44a1-9daa-df17dca140a4" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-df82580c-407b-44a1-9daa-df17dca140a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Deleting offline snapshot df82580c-407b-44a1-9daa-df17dca140a4 of volume 1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] snapshot_file for this snap is: volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48878e-550c-43ab-b9f4-0f0c9783a82f]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:22 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 Apr 29 09:15:22 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:22 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b" returned: 0 in 0.650s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:22 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b is being set with open permissions: ugo+rw Apr 29 09:15:22 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:23 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b Apr 29 09:15:23 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:23 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395" returned: 0 in 0.769s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:23 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c Apr 29 09:15:23 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:23 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4" returned: 0 in 0.731s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1410b681-90b5-45d0-b3a3-0b23f76826b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[661cfd9b-71fa-4329-a2f8-364f78841f9e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:23 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 Apr 29 09:15:23 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:23 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b" returned: 0 in 0.608s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:23 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.info Apr 29 09:15:23 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:23 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" returned: 0 in 0.717s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:23 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:23 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c Apr 29 09:15:23 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:24 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:24 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.info" returned: 0 in 0.614s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:24 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.info is being set with open permissions: ugo+rw Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2" returned: 0 in 0.832s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:24 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.info Apr 29 09:15:24 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:24 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 Apr 29 09:15:24 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:24 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395.a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" returned: 0 in 0.587s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c" released by "_delete_snapshot" :: held 2.999s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-9fea0b94-9d11-46b1-ae12-55cde09e7395" released by "delete_snapshot" :: held 3.033s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Created reservations ['31555a9a-83a9-4652-ae5c-8309a838932a', '64a2571f-4adc-4eb4-97c6-a9ffb394b553', '664a08e6-560c-4427-9f3f-ac84ecbaaf23', '22d2f79c-4d73-4497-ae8d-7415e23362fd'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:24 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Delete snapshot completed successfully. Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-23d19375-07c9-417a-9a06-5e643f25aaea tempest-CinderUnicodeTest-878983989 None] Lock "cinder-a4d3bf6f-1d3e-4ce8-a797-2b35c88b7a1c-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:24 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.info" returned: 0 in 0.593s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.110s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:24 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-5a2abd66-af81-43d7-ad73-d31a18a9ccf7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Create snapshot completed successfully Apr 29 09:15:25 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4" returned: 0 in 0.762s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:25 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4 Apr 29 09:15:25 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (2d81ca8f-5017-49fb-8fab-017a4c39f9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e6e02d-f74f-4154-8c7f-3d05ea1bf5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:25 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2.df82580c-407b-44a1-9daa-df17dca140a4" returned: 0 in 0.609s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e6e02d-f74f-4154-8c7f-3d05ea1bf5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674749637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82d36fa-e6eb-4275-a5e1-e3f2bf37399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:26Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca6539b-adfe-4f50-bee3-133d1f88e559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca6539b-adfe-4f50-bee3-133d1f88e559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8bbe3-0771-423f-a0e4-fb4bdaa7f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f8bbe3-0771-423f-a0e4-fb4bdaa7f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82d36fa-e6eb-4275-a5e1-e3f2bf37399f', 'volume_name': 'volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb93b25-53d1-496f-a8c6-faa576c6b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb93b25-53d1-496f-a8c6-faa576c6b04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65912cd-6d43-4fa9-8f9b-2a00feac23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:25 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume f82d36fa-e6eb-4275-a5e1-e3f2bf37399f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f', 'volume_size': 1} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674749637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82d36fa-e6eb-4275-a5e1-e3f2bf37399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:26Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Creating volume f82d36fa-e6eb-4275-a5e1-e3f2bf37399f {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:25 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Acquiring lock "cinder-9fea0b94-9d11-46b1-ae12-55cde09e7395-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:25 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f 1073741824 Apr 29 09:15:25 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Lock "cinder-9fea0b94-9d11-46b1-ae12-55cde09e7395-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-df82580c-407b-44a1-9daa-df17dca140a4" released by "_delete_snapshot" :: held 3.182s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" released by "delete_snapshot" :: held 3.222s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Acquiring lock "cinder-quobyte-9fea0b94-9d11-46b1-ae12-55cde09e7395" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-9fea0b94-9d11-46b1-ae12-55cde09e7395" acquired by "delete_volume" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[547bbdef-ceef-4ba0-b4ba-b9d67b1af059]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Created reservations ['dbadf1fe-7291-4be2-9325-22c79b715176', '939571c7-465f-4ed6-9e69-c33af30a0cbd', 'd187dd83-fe91-4b17-9518-57176823e728', 'd63aebcd-14dc-402e-9bdc-cdb622f51556'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:26 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 Apr 29 09:15:26 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:26 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Delete snapshot completed successfully. Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-334eba97-c2b5-4a89-ad12-b6265db7622b tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-df82580c-407b-44a1-9daa-df17dca140a4-delete_snapshot" released by "delete_snapshot" :: held 3.635s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (1a23dd87-9c3b-448c-94e5-a2dd63370b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c975b18a-2ae1-4f7e-88f3-fbc14956dcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c975b18a-2ae1-4f7e-88f3-fbc14956dcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-684713857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a5cfcb-3787-472a-bc37-3ed9771c80b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:26Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae0153b-c7e6-45cd-abad-93c1a3cd5547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae0153b-c7e6-45cd-abad-93c1a3cd5547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e81be3-2bd7-4cd5-86b0-b1a188a36909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e81be3-2bd7-4cd5-86b0-b1a188a36909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a5cfcb-3787-472a-bc37-3ed9771c80b7', 'volume_name': 'volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cacabf2-6846-48fe-b0df-81057488c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cacabf2-6846-48fe-b0df-81057488c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c42561a-17e7-4824-b137-9502dcae5aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume a6a5cfcb-3787-472a-bc37-3ed9771c80b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7', 'volume_size': 1} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (4c58cda5-b4cc-4986-a62c-e5c37f48fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd340163-5350-4502-9ec4-2d5f9a9a0c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd340163-5350-4502-9ec4-2d5f9a9a0c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1238130639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419d9a8f-c9b3-476f-aca7-140f1d14f6b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:27Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed021d1-f583-49c2-8e45-f71e4227a009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed021d1-f583-49c2-8e45-f71e4227a009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b798048d-679c-403b-a713-98b70f2aab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b798048d-679c-403b-a713-98b70f2aab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419d9a8f-c9b3-476f-aca7-140f1d14f6b7', 'volume_name': 'volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0048fbd7-34dd-4504-b2a8-a2667580d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0048fbd7-34dd-4504-b2a8-a2667580d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe02dec-6213-4be5-8c7d-a12a72e65717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:26 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume 419d9a8f-c9b3-476f-aca7-140f1d14f6b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7', 'volume_size': 1} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:26 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395" returned: 0 in 1.007s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-1410b681-90b5-45d0-b3a3-0b23f76826b2-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:27 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395 Apr 29 09:15:27 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-1410b681-90b5-45d0-b3a3-0b23f76826b2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:27 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" acquired by "delete_volume" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f 1073741824" returned: 0 in 1.477s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18c88bc-a310-4398-b8f7-72b4946bb2d5]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (dbaa71fa-4167-46dd-89cf-f67239c3b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e908993-0f1b-4b34-a441-e6b1fc34abed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e908993-0f1b-4b34-a441-e6b1fc34abed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766882672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97baf757-1146-46fa-9232-99c67874a929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:27Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4319fb-0d3c-472a-8d5a-d81c2dc16757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4319fb-0d3c-472a-8d5a-d81c2dc16757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9ff4d6-6509-4d66-a194-6c1ed786b995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9ff4d6-6509-4d66-a194-6c1ed786b995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97baf757-1146-46fa-9232-99c67874a929', 'volume_name': 'volume-97baf757-1146-46fa-9232-99c67874a929', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7f52d2-831e-485e-b20a-45cfcccfb59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7f52d2-831e-485e-b20a-45cfcccfb59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab29d4f-0eb3-4b02-84e3-06e420a4601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume 97baf757-1146-46fa-9232-99c67874a929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97baf757-1146-46fa-9232-99c67874a929', 'volume_size': 1} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:27 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 Apr 29 09:15:27 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:27 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f Apr 29 09:15:27 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (394d4f91-0c68-4585-90e0-1bb75cc60d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5873d4ff-7cad-439d-b076-271163d54b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5873d4ff-7cad-439d-b076-271163d54b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357325976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb518db9-3529-4952-9229-867a2e16ca3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:27Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a896fbb-e94f-4b1a-8e65-defafbdfe6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a896fbb-e94f-4b1a-8e65-defafbdfe6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfc7b30-72eb-4858-be9e-14450d0b632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfc7b30-72eb-4858-be9e-14450d0b632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb518db9-3529-4952-9229-867a2e16ca3f', 'volume_name': 'volume-cb518db9-3529-4952-9229-867a2e16ca3f', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4959eade-8126-4f05-a1f2-2ba7c266d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4959eade-8126-4f05-a1f2-2ba7c266d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87adc681-4913-4091-989b-2ad073a4983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:27 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume cb518db9-3529-4952-9229-867a2e16ca3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb518db9-3529-4952-9229-867a2e16ca3f', 'volume_size': 1} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:27 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-9fea0b94-9d11-46b1-ae12-55cde09e7395" returned: 0 in 0.785s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-9fea0b94-9d11-46b1-ae12-55cde09e7395" released by "delete_volume" :: held 1.884s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Created reservations ['5e24beb8-c127-4fe8-9cea-7ec98b30c607', 'c32b46c1-c3c6-4989-a421-7058265a80f4', '45f382ab-05cb-4828-8f3c-f141d534a6ba', '009dbd1e-790c-4e4b-a487-26e0d8a25553'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:27 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:27 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Acquiring lock "cinder-278fe30d-5b72-4038-82ec-90533dd2c11e-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Lock "cinder-278fe30d-5b72-4038-82ec-90533dd2c11e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:28 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:28 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f" returned: 0 in 0.777s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] <== create_volume: return (2407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2" returned: 0 in 0.907s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-684713857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a5cfcb-3787-472a-bc37-3ed9771c80b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:26Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Creating volume a6a5cfcb-3787-472a-bc37-3ed9771c80b7 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:28 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:28 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 1073741824 Apr 29 09:15:28 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:28 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2 Apr 29 09:15:28 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65912cd-6d43-4fa9-8f9b-2a00feac23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4b239c-7ade-4c2c-925b-e0cf2048d72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Acquiring lock "cinder-quobyte-278fe30d-5b72-4038-82ec-90533dd2c11e" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:28 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f (f82d36fa-e6eb-4275-a5e1-e3f2bf37399f): created successfully Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4b239c-7ade-4c2c-925b-e0cf2048d72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (2d81ca8f-5017-49fb-8fab-017a4c39f9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-278fe30d-5b72-4038-82ec-90533dd2c11e" acquired by "delete_volume" :: waited 0.046s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:28 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-6e79e108-1a62-46a9-a1f3-9bad02bff781 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created volume successfully. Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf45b5e0-9210-4cc7-a431-e409a71e0626]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:28 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e Apr 29 09:15:28 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:28 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.753s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:28 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Deleted volume successfully. Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ebff5b34-070a-457b-be20-75f2fcc824a2 tempest-CinderUnicodeTest-878983989 None] Lock "cinder-9fea0b94-9d11-46b1-ae12-55cde09e7395-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:28 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1410b681-90b5-45d0-b3a3-0b23f76826b2" returned: 0 in 0.750s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-quobyte-1410b681-90b5-45d0-b3a3-0b23f76826b2" released by "delete_volume" :: held 1.769s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:28 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Created reservations ['419b88f3-777d-441a-a9f6-94fb80acde44', 'b6654ff1-f3b3-43e2-9016-e7495bade9f1', '3b911979-d9cc-4b7b-b793-9f2647e7cdc7', '2e3de003-72d0-4999-82e2-86708e161f4e'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:29 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 1073741824" returned: 0 in 0.878s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:29 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:29 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:29 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 Apr 29 09:15:29 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:29 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e" returned: 0 in 0.873s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:29 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e Apr 29 09:15:29 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:29 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.674s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Deleted volume successfully. Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7f8bd338-9503-4421-a51a-4a7ba1eb4187 tempest-VolumesSnapshotListTestJSON-488714799 None] Lock "cinder-1410b681-90b5-45d0-b3a3-0b23f76826b2-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:29 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7" returned: 0 in 0.710s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.056s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1238130639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419d9a8f-c9b3-476f-aca7-140f1d14f6b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:27Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Creating volume 419d9a8f-c9b3-476f-aca7-140f1d14f6b7 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:29 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:29 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 1073741824 Apr 29 09:15:29 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c42561a-17e7-4824-b137-9502dcae5aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52148fd3-73a4-490b-8e6f-0f29797ac1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 (a6a5cfcb-3787-472a-bc37-3ed9771c80b7): created successfully Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52148fd3-73a4-490b-8e6f-0f29797ac1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (1a23dd87-9c3b-448c-94e5-a2dd63370b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b054e832-2abb-4faa-867b-34e2090a64c7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created volume successfully. Apr 29 09:15:29 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-278fe30d-5b72-4038-82ec-90533dd2c11e" returned: 0 in 0.728s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Lock "cinder-quobyte-278fe30d-5b72-4038-82ec-90533dd2c11e" released by "delete_volume" :: held 1.657s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:29 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Created reservations ['eb40ee85-4b43-4de1-87c9-755eee69a11d', '404c1c70-3235-4120-b797-b176bb73fc7f', '93009fc9-b7e0-4f58-b014-eba06d8eff84', '6016d084-d88e-4522-a3bd-0febe1baeca5'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:30 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:30 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:30 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.722s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:30 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Deleted volume successfully. Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-32bfe224-cbad-4140-955c-6d97002015fb tempest-CinderUnicodeTest-878983989 None] Lock "cinder-278fe30d-5b72-4038-82ec-90533dd2c11e-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:30 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 1073741824" returned: 0 in 1.075s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:30 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 Apr 29 09:15:30 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:31 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7" returned: 0 in 0.663s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.261s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766882672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97baf757-1146-46fa-9232-99c67874a929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:27Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Creating volume 97baf757-1146-46fa-9232-99c67874a929 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:31 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:31 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 1073741824 Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe02dec-6213-4be5-8c7d-a12a72e65717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:31 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebfae89-5df4-40ef-94fb-4c840b79f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:31 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 (419d9a8f-c9b3-476f-aca7-140f1d14f6b7): created successfully Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebfae89-5df4-40ef-94fb-4c840b79f861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:31 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (4c58cda5-b4cc-4986-a62c-e5c37f48fb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:31 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9bf1db6e-beab-4ec3-847c-5ef09535a571 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created volume successfully. Apr 29 09:15:32 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 1073741824" returned: 0 in 0.791s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:32 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 Apr 29 09:15:32 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:33 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929" returned: 0 in 0.581s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.407s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357325976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb518db9-3529-4952-9229-867a2e16ca3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf9d95e9324920ac68a3f5b0fa6c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:27Z,use_quota=True,user_id='5fd85bc3b4f04d6bafd3396e00a2c497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Creating volume cb518db9-3529-4952-9229-867a2e16ca3f {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:33 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:33 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f 1073741824 Apr 29 09:15:33 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab29d4f-0eb3-4b02-84e3-06e420a4601b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97baf757-1146-46fa-9232-99c67874a929', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ebff0-1e1b-44f6-83d2-747c1097a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:33 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume volume-97baf757-1146-46fa-9232-99c67874a929 (97baf757-1146-46fa-9232-99c67874a929): created successfully Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ebff0-1e1b-44f6-83d2-747c1097a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (dbaa71fa-4167-46dd-89cf-f67239c3b05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-54c03758-4444-411a-91fe-17b559c71ce0 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created volume successfully. Apr 29 09:15:33 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f 1073741824" returned: 0 in 0.716s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:33 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f Apr 29 09:15:33 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:34 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f" returned: 0 in 0.567s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87adc681-4913-4091-989b-2ad073a4983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb518db9-3529-4952-9229-867a2e16ca3f', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c6c042-68dc-4075-86a7-ef4e2b60cd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:34 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Volume volume-cb518db9-3529-4952-9229-867a2e16ca3f (cb518db9-3529-4952-9229-867a2e16ca3f): created successfully Apr 29 09:15:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c6c042-68dc-4075-86a7-ef4e2b60cd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:34 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Flow 'volume_create_manager' (394d4f91-0c68-4585-90e0-1bb75cc60d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:34 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4134aa5f-0c02-4ec8-a806-65f90db0cab7 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created volume successfully. Apr 29 09:15:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-cb518db9-3529-4952-9229-867a2e16ca3f-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-cb518db9-3529-4952-9229-867a2e16ca3f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-cb518db9-3529-4952-9229-867a2e16ca3f" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:35 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-cb518db9-3529-4952-9229-867a2e16ca3f" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:35 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf8b9b-47c2-4553-ae75-7283d282875a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:35 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f Apr 29 09:15:35 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:36 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f" returned: 0 in 0.708s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:36 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f Apr 29 09:15:36 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:36 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cb518db9-3529-4952-9229-867a2e16ca3f" returned: 0 in 0.587s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-cb518db9-3529-4952-9229-867a2e16ca3f" released by "delete_volume" :: held 1.331s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Created reservations ['cd428c10-50e5-4114-803f-a8ea75639778', 'bb10aa34-7621-4b6c-b2d4-b01013848f0b', '43b65c15-127f-490e-821e-bf4f938c8211', 'a12b9163-3163-49d1-9dbe-9fdf301383bd'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:36 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:36 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:37 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.566s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Deleted volume successfully. Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7c4a40cd-31f8-410b-897e-0ed651f51bba tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-cb518db9-3529-4952-9229-867a2e16ca3f-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-97baf757-1146-46fa-9232-99c67874a929-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-97baf757-1146-46fa-9232-99c67874a929-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-97baf757-1146-46fa-9232-99c67874a929" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-97baf757-1146-46fa-9232-99c67874a929" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e10f38-4fad-43c0-ac38-f7e71e6ef09a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:37 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 Apr 29 09:15:37 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:38 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929" returned: 0 in 0.669s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:38 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929 Apr 29 09:15:38 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:38 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-97baf757-1146-46fa-9232-99c67874a929" returned: 0 in 0.575s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:38 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-97baf757-1146-46fa-9232-99c67874a929" released by "delete_volume" :: held 1.282s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:38 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created reservations ['e3a48210-41df-4eba-a020-dc2cab7fab5a', '1efd9935-2728-40a4-ae5a-c550827072ca', '54a80744-e0a8-4e25-95d4-90ce9de06697', '68fa9459-6489-4e2a-8668-8ef1524b5f9b'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:39 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:39 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:39 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.559s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:39 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Deleted volume successfully. Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8a195dca-81e4-47b0-8b8a-d6b5a76e8af6 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-97baf757-1146-46fa-9232-99c67874a929-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-419d9a8f-c9b3-476f-aca7-140f1d14f6b7-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-419d9a8f-c9b3-476f-aca7-140f1d14f6b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-419d9a8f-c9b3-476f-aca7-140f1d14f6b7" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-419d9a8f-c9b3-476f-aca7-140f1d14f6b7" acquired by "delete_volume" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6bac8c-f217-4826-acc9-618e8153ced2]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:39 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 Apr 29 09:15:39 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:40 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7" returned: 0 in 0.704s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:40 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7 Apr 29 09:15:40 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:41 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-419d9a8f-c9b3-476f-aca7-140f1d14f6b7" returned: 0 in 0.562s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-419d9a8f-c9b3-476f-aca7-140f1d14f6b7" released by "delete_volume" :: held 1.305s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created reservations ['60142263-e135-4840-877a-1c95388aa3be', '9ebca1e9-983c-477f-87f3-ddf9128b2ef5', 'a5a8f6b1-05c8-4d14-9046-d28cab81c891', '3574b948-d480-47e0-8e0f-02242cdbee55'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:41 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:41 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:41 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.560s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:41 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Deleted volume successfully. Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-f5dede59-e7f1-46b8-a018-f91751bbf321 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-419d9a8f-c9b3-476f-aca7-140f1d14f6b7-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:41 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-a6a5cfcb-3787-472a-bc37-3ed9771c80b7-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-a6a5cfcb-3787-472a-bc37-3ed9771c80b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-a6a5cfcb-3787-472a-bc37-3ed9771c80b7" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-a6a5cfcb-3787-472a-bc37-3ed9771c80b7" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c93e6a-5713-4dc1-a761-bf2f0a029db9]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:42 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 Apr 29 09:15:42 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:42 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7" returned: 0 in 0.662s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:42 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7 Apr 29 09:15:42 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:43 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a6a5cfcb-3787-472a-bc37-3ed9771c80b7" returned: 0 in 0.568s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-a6a5cfcb-3787-472a-bc37-3ed9771c80b7" released by "delete_volume" :: held 1.270s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created reservations ['d44a7a14-3635-4649-970e-b2c632c629db', 'b73d7720-7e15-45f2-894f-5328ea6b462f', '5241647e-d373-463e-856a-f3e6d3bae4dc', 'e1245fe7-6cc0-410f-bca5-484e95b3f7e1'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:43 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:43 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:43 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.556s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:43 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:43 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Deleted volume successfully. Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f583589-ec94-43fa-b134-ae2ce4692758 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-a6a5cfcb-3787-472a-bc37-3ed9771c80b7-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[df212292-ba77-4714-948c-dc53114c3e24]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:44 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f Apr 29 09:15:44 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:44 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f" returned: 0 in 0.682s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:44 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f Apr 29 09:15:44 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:45 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f" returned: 0 in 0.586s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f" released by "delete_volume" :: held 1.311s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created reservations ['709ca999-439e-4ac5-abab-703663e85cf3', '4c00f317-7e5c-4959-9739-b83406dae22e', '7b296e29-87ac-41c8-b766-e2562379ad96', 'e7d74c82-c922-44ea-8f61-72683e563df6'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:45 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:45 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:46 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.554s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:46 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Deleted volume successfully. Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8949350b-b731-48c9-92e1-f60d3ff53ba8 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-f82d36fa-e6eb-4275-a5e1-e3f2bf37399f-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-318f64f4-8696-4de2-af5b-982c62622a9b-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-318f64f4-8696-4de2-af5b-982c62622a9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-5874ceb9-d1a7-4741-9690-0cada09d8c0b" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-5874ceb9-d1a7-4741-9690-0cada09d8c0b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-318f64f4-8696-4de2-af5b-982c62622a9b" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-318f64f4-8696-4de2-af5b-982c62622a9b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Deleting offline snapshot 318f64f4-8696-4de2-af5b-982c62622a9b of volume 5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] snapshot_file for this snap is: volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[db10f100-7d97-4514-ad8f-1cfb31e38c39]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:46 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b Apr 29 09:15:46 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:47 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b" returned: 0 in 0.676s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:15:47 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6e422-a17b-4824-87dd-4248ec0b8e4c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:47 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b Apr 29 09:15:47 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:47 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b" returned: 0 in 0.658s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:47 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b Apr 29 09:15:47 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:48 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b" returned: 0 in 0.686s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:48 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b Apr 29 09:15:48 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:49 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b.318f64f4-8696-4de2-af5b-982c62622a9b" returned: 0 in 0.598s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-318f64f4-8696-4de2-af5b-982c62622a9b" released by "_delete_snapshot" :: held 2.713s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-5874ceb9-d1a7-4741-9690-0cada09d8c0b" released by "delete_snapshot" :: held 2.732s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created reservations ['5a1b6f27-05ae-4899-bfd7-2439c9c91ad7', '69e5e7c0-79c9-4397-83e8-0565d077df46', '7be828e8-8b62-4245-a79f-584a7915a2a9', 'dba5c2d4-2c0e-4f9b-afcf-0ff7d16b3b2f'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:49 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Delete snapshot completed successfully. Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-423e297b-5d58-4eec-8a8a-f168fe0ab604 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-318f64f4-8696-4de2-af5b-982c62622a9b-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-5874ceb9-d1a7-4741-9690-0cada09d8c0b-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-5874ceb9-d1a7-4741-9690-0cada09d8c0b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "cinder-quobyte-5874ceb9-d1a7-4741-9690-0cada09d8c0b" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-5874ceb9-d1a7-4741-9690-0cada09d8c0b" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c214d6-461c-43f8-b07b-7c01040e8eaf]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:15:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:49 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b Apr 29 09:15:49 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:50 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b" returned: 0 in 0.674s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:50 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b Apr 29 09:15:50 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:50 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5874ceb9-d1a7-4741-9690-0cada09d8c0b" returned: 0 in 0.553s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-quobyte-5874ceb9-d1a7-4741-9690-0cada09d8c0b" released by "delete_volume" :: held 1.284s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:50 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Created reservations ['b1e231d0-034a-4652-a8b0-7a0f1b797eda', '52f77d9b-58a2-451b-8714-8efac751b463', '7375d611-4768-492c-b272-19406571af52', 'ff78313c-25d4-4ed6-8c08-804a42b80fea'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:51 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:15:51 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:51 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.565s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:15:51 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Deleted volume successfully. Apr 29 09:15:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c86375a5-6b9a-4f29-9aa3-83c66c71af00 tempest-CreateVolumesFromSnapshotTest-386134175 None] Lock "cinder-5874ceb9-d1a7-4741-9690-0cada09d8c0b-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (ce0545a3-1b78-4e0d-a8a5-72989adc25f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c98066-56d1-4587-b17f-15e8f8d7e91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c98066-56d1-4587-b17f-15e8f8d7e91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311834866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f2cd69-eff2-4dbc-8878-26c4c25a906b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:54Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb7fcda-e8df-48c5-9478-bfcdd463faa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb7fcda-e8df-48c5-9478-bfcdd463faa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e8dc5-41ac-49f8-a864-100cfd82a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e8dc5-41ac-49f8-a864-100cfd82a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f2cd69-eff2-4dbc-8878-26c4c25a906b', 'volume_name': 'volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c060b942-4656-42f3-a1f1-fdbd5e3ec5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c060b942-4656-42f3-a1f1-fdbd5e3ec5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19961a44-de20-4456-8ae6-a35c91f7edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:54 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume e5f2cd69-eff2-4dbc-8878-26c4c25a906b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b', 'volume_size': 1} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311834866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f2cd69-eff2-4dbc-8878-26c4c25a906b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:54Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Creating volume e5f2cd69-eff2-4dbc-8878-26c4c25a906b {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:54 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:54 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b 1073741824 Apr 29 09:15:54 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:55 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b 1073741824" returned: 0 in 0.748s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:55 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b Apr 29 09:15:55 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:55 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b" returned: 0 in 0.584s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=177,cinder:INSERT=49,cinder:SELECT=123,cinder:DELETE=11 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19961a44-de20-4456-8ae6-a35c91f7edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1f8d27-ac21-4f1a-b598-f9d3abb4b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:55 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b (e5f2cd69-eff2-4dbc-8878-26c4c25a906b): created successfully Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1f8d27-ac21-4f1a-b598-f9d3abb4b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (ce0545a3-1b78-4e0d-a8a5-72989adc25f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:55 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8fb52a8a-df3d-4697-bc38-08b6fa5a25fb tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created volume successfully. Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (59146ee3-3c31-4472-beb0-06f94c86332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927a0813-e142-4310-a518-0f1eb7739975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927a0813-e142-4310-a518-0f1eb7739975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-210301060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5b8f66-d7f6-4e07-bb48-a604f9c2229c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:57Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3eaa49-e2b8-4628-b13d-7d773e0b8358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3eaa49-e2b8-4628-b13d-7d773e0b8358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50944c4-0b01-4138-8aad-e87bb279c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50944c4-0b01-4138-8aad-e87bb279c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5b8f66-d7f6-4e07-bb48-a604f9c2229c', 'volume_name': 'volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510c6aba-4a85-4898-bef1-69594213f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510c6aba-4a85-4898-bef1-69594213f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3ee4d0-f290-4498-80f8-4e4b876d3aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:56 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume 5a5b8f66-d7f6-4e07-bb48-a604f9c2229c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c', 'volume_size': 1} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-210301060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5b8f66-d7f6-4e07-bb48-a604f9c2229c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:57Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Creating volume 5a5b8f66-d7f6-4e07-bb48-a604f9c2229c {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:56 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:56 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c 1073741824 Apr 29 09:15:56 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:56 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (a9e37acb-2ddb-4877-8ac9-7789d77839ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226c879-c997-46d6-98fd-f8203ac78cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226c879-c997-46d6-98fd-f8203ac78cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1875840471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf94016c-86e7-4bcb-91da-539a8408403d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:57Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70548e5a-2acc-410c-9d04-dee797b47faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70548e5a-2acc-410c-9d04-dee797b47faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d885220-e964-4dc8-932e-81f6a1cd18b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d885220-e964-4dc8-932e-81f6a1cd18b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf94016c-86e7-4bcb-91da-539a8408403d', 'volume_name': 'volume-cf94016c-86e7-4bcb-91da-539a8408403d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbb37df-2745-4dd8-9b9f-45596d8a3cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbb37df-2745-4dd8-9b9f-45596d8a3cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c46eea-f905-40f9-a40d-f3b15070843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume cf94016c-86e7-4bcb-91da-539a8408403d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf94016c-86e7-4bcb-91da-539a8408403d', 'volume_size': 1} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (3635be0c-9f76-4366-9981-a94ff312223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f870e1-76c3-4da0-a5a9-69a80c5dca2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f870e1-76c3-4da0-a5a9-69a80c5dca2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719604294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd618e8-26a8-4bca-8528-d585dc7e72fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:57Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1785826-766c-4327-baa7-a1df9178c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1785826-766c-4327-baa7-a1df9178c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198755dd-20e2-4db2-b55d-b8fde151a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198755dd-20e2-4db2-b55d-b8fde151a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd618e8-26a8-4bca-8528-d585dc7e72fe', 'volume_name': 'volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef58412-c45a-4bb4-a0ee-75a8048b54b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef58412-c45a-4bb4-a0ee-75a8048b54b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6efa3eb-98f9-4e67-b74e-98bc5dc0c518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume 1cd618e8-26a8-4bca-8528-d585dc7e72fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe', 'volume_size': 1} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:57 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c 1073741824" returned: 0 in 0.833s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:57 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c Apr 29 09:15:57 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (6231bf60-0994-47e8-a646-6f1b48a252dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24faee5c-6f54-4ce5-b77c-22a0fe18f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24faee5c-6f54-4ce5-b77c-22a0fe18f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732276608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3298aaf8-7078-4977-abc6-0acb42ec29d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:58Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d553b951-4454-48c4-969e-6d32877a0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d553b951-4454-48c4-969e-6d32877a0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9dc97a0-681b-4a57-bbc5-25fd9b28d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9dc97a0-681b-4a57-bbc5-25fd9b28d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3298aaf8-7078-4977-abc6-0acb42ec29d3', 'volume_name': 'volume-3298aaf8-7078-4977-abc6-0acb42ec29d3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06284a15-04ec-48ea-b223-5a16b922800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06284a15-04ec-48ea-b223-5a16b922800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0976594c-84d0-46a3-8b81-76d6c58033bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:57 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume 3298aaf8-7078-4977-abc6-0acb42ec29d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3298aaf8-7078-4977-abc6-0acb42ec29d3', 'volume_size': 1} Apr 29 09:15:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=168,cinder:SELECT=135,cinder:DELETE=17,cinder:INSERT=38 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (a066261d-5717-4eb6-a9bc-8596f445266d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e2436b-714d-4c6d-bdc6-b88485e038a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e2436b-714d-4c6d-bdc6-b88485e038a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468890775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:58Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e75c9-2bab-4d0f-b476-eaf0aa609a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e75c9-2bab-4d0f-b476-eaf0aa609a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f74188f-4a99-4cd8-a145-0274fbdb2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f74188f-4a99-4cd8-a145-0274fbdb2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a', 'volume_name': 'volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b46003-d2c1-41b6-9758-c09e1e851606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b46003-d2c1-41b6-9758-c09e1e851606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7910944-fdda-4a4f-96f3-d0e8113859c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a', 'volume_size': 1} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:58 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c" returned: 0 in 0.621s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.208s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1875840471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf94016c-86e7-4bcb-91da-539a8408403d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:57Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Creating volume cf94016c-86e7-4bcb-91da-539a8408403d {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:58 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3ee4d0-f290-4498-80f8-4e4b876d3aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:58 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d 1073741824 Apr 29 09:15:58 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b0638-0d8f-4e3d-9e70-ca888cd2cf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c (5a5b8f66-d7f6-4e07-bb48-a604f9c2229c): created successfully Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b0638-0d8f-4e3d-9e70-ca888cd2cf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (59146ee3-3c31-4472-beb0-06f94c86332f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-579d3720-f5fc-433e-9a4e-2f06d63da25b tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created volume successfully. Apr 29 09:15:59 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d 1073741824" returned: 0 in 0.730s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:59 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d Apr 29 09:15:59 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:59 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d" returned: 0 in 0.629s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719604294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd618e8-26a8-4bca-8528-d585dc7e72fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:57Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Creating volume 1cd618e8-26a8-4bca-8528-d585dc7e72fe {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:15:59 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c46eea-f905-40f9-a40d-f3b15070843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf94016c-86e7-4bcb-91da-539a8408403d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:59 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe 1073741824 Apr 29 09:15:59 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1465ed57-f587-4d2d-b3b0-e94db86ab54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:15:59 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume volume-cf94016c-86e7-4bcb-91da-539a8408403d (cf94016c-86e7-4bcb-91da-539a8408403d): created successfully Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1465ed57-f587-4d2d-b3b0-e94db86ab54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:15:59 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (a9e37acb-2ddb-4877-8ac9-7789d77839ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:15:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2e73fa04-e90b-41e0-9b36-b0847f0f6d67 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created volume successfully. Apr 29 09:16:00 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe 1073741824" returned: 0 in 0.788s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:00 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe Apr 29 09:16:00 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:01 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe" returned: 0 in 0.591s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.301s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732276608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3298aaf8-7078-4977-abc6-0acb42ec29d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:58Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Creating volume 3298aaf8-7078-4977-abc6-0acb42ec29d3 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:01 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6efa3eb-98f9-4e67-b74e-98bc5dc0c518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:01 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 1073741824 Apr 29 09:16:01 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faea39c0-64c0-4796-9bbe-8461304d4128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:01 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe (1cd618e8-26a8-4bca-8528-d585dc7e72fe): created successfully Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faea39c0-64c0-4796-9bbe-8461304d4128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (3635be0c-9f76-4366-9981-a94ff312223e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:01 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d59a6a15-7199-498a-8b4c-33079b21a92f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created volume successfully. Apr 29 09:16:01 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 1073741824" returned: 0 in 0.761s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:01 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 Apr 29 09:16:01 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:02 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3" returned: 0 in 0.608s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.435s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468890775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac705c4afa934f4bb4351a2d1db458e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:58Z,use_quota=True,user_id='a4a24b00e42c45198a5cfda392258d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Creating volume fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:02 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:02 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:02 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:02 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a 1073741824 Apr 29 09:16:02 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0976594c-84d0-46a3-8b81-76d6c58033bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3298aaf8-7078-4977-abc6-0acb42ec29d3', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84450a7-da62-4185-a0c3-2dcfc391317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:02 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 (3298aaf8-7078-4977-abc6-0acb42ec29d3): created successfully Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84450a7-da62-4185-a0c3-2dcfc391317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:02 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (6231bf60-0994-47e8-a646-6f1b48a252dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:02 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e724729a-dc48-47f6-b135-76c98ea56f97 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created volume successfully. Apr 29 09:16:03 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:03 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a 1073741824" returned: 0 in 0.774s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:03 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a Apr 29 09:16:03 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:03 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a" returned: 0 in 0.589s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7910944-fdda-4a4f-96f3-d0e8113859c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:03 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45fc1ae-693e-4dd1-a8ab-53b105ea82f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:03 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Volume volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a (fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a): created successfully Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45fc1ae-693e-4dd1-a8ab-53b105ea82f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Flow 'volume_create_manager' (a066261d-5717-4eb6-a9bc-8596f445266d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4d77f9b2-156e-46bc-870c-0e2d0c5565d9 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created volume successfully. Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-quobyte-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a" acquired by "delete_volume" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ed894c-abd4-4286-8484-4373973cd8ec]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:04 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a Apr 29 09:16:04 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:05 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a" returned: 0 in 0.696s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:05 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a Apr 29 09:16:05 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:05 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a" returned: 0 in 0.600s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a" released by "delete_volume" :: held 1.335s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created reservations ['cc07b459-9ab2-4326-a530-1bf153117582', 'ec728142-ff49-4bf5-9843-3db247289ae4', '25dabd03-682b-4b8b-924e-3f3dc17d04bf', '09d0bd3e-6ccf-45a4-885c-46bf50fa6314'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:06 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:06 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:06 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.582s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Deleted volume successfully. Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-19bae15e-91b0-4aa6-a6e4-bc2958d0b3be tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-fcc12dcb-ee5e-4ed6-b447-52ccb293bd3a-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-3298aaf8-7078-4977-abc6-0acb42ec29d3-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-3298aaf8-7078-4977-abc6-0acb42ec29d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-quobyte-3298aaf8-7078-4977-abc6-0acb42ec29d3" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-3298aaf8-7078-4977-abc6-0acb42ec29d3" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3894a3dd-b4d3-4578-ab56-83ea73423985]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:06 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 Apr 29 09:16:06 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:07 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3" returned: 0 in 0.675s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:07 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3 Apr 29 09:16:07 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:08 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3298aaf8-7078-4977-abc6-0acb42ec29d3" returned: 0 in 0.577s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-3298aaf8-7078-4977-abc6-0acb42ec29d3" released by "delete_volume" :: held 1.291s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created reservations ['81a96cd1-8b4c-4c58-85dc-9132d2a4839c', '239c20ab-8d3c-412d-9a0a-2acf5b6cfa74', 'af502c89-e3e1-4bfd-9080-9def76dd9684', 'fac5e5a8-b226-47ae-a2eb-9783998d0f40'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:08 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:08 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:08 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.581s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Deleted volume successfully. Apr 29 09:16:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0201a313-3fe2-4db0-948d-dc65125f7783 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-3298aaf8-7078-4977-abc6-0acb42ec29d3-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-1cd618e8-26a8-4bca-8528-d585dc7e72fe-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-1cd618e8-26a8-4bca-8528-d585dc7e72fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-quobyte-1cd618e8-26a8-4bca-8528-d585dc7e72fe" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-1cd618e8-26a8-4bca-8528-d585dc7e72fe" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45cb5d-c00b-433e-a588-d6e1bb4c9c28]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:09 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe Apr 29 09:16:09 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:09 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe" returned: 0 in 0.715s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:09 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe Apr 29 09:16:09 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:10 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1cd618e8-26a8-4bca-8528-d585dc7e72fe" returned: 0 in 0.569s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-1cd618e8-26a8-4bca-8528-d585dc7e72fe" released by "delete_volume" :: held 1.327s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created reservations ['51241ad4-0bc6-40b4-8778-0d0028b6e82d', 'f9ac088a-be67-4364-9f86-2eb15aca0524', '525ab40e-ed40-410b-b99d-10d170415b4c', '1bd0bc77-4512-4f99-99b4-7f1572162390'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:10 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:10 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:11 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.590s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:11 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Deleted volume successfully. Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-664144e2-2c56-4819-9c98-ae63790b300f tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-1cd618e8-26a8-4bca-8528-d585dc7e72fe-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-cf94016c-86e7-4bcb-91da-539a8408403d-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-cf94016c-86e7-4bcb-91da-539a8408403d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-quobyte-cf94016c-86e7-4bcb-91da-539a8408403d" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-cf94016c-86e7-4bcb-91da-539a8408403d" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[2022c028-c6a3-4b8b-bc39-b68bf10d4544]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:11 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d Apr 29 09:16:11 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:11 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d" returned: 0 in 0.682s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:12 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d Apr 29 09:16:12 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:12 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cf94016c-86e7-4bcb-91da-539a8408403d" returned: 0 in 0.562s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-cf94016c-86e7-4bcb-91da-539a8408403d" released by "delete_volume" :: held 1.282s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created reservations ['681502cf-93fb-482c-badc-d2a18b5bc2b8', '7df19e18-1852-46b1-b126-19f311afaf26', '06113f13-b5b3-4a54-9738-c26e4a25c31a', '3fb481d3-f20a-46f7-8703-8cf0ea6480eb'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:12 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:12 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:13 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.560s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:13 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Deleted volume successfully. Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1d5bfb2c-b51b-4853-a327-7ae5d07e4e55 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-cf94016c-86e7-4bcb-91da-539a8408403d-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-quobyte-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c" acquired by "delete_volume" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[92961213-025a-47f1-ab8a-2e1916a034f9]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:13 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c Apr 29 09:16:13 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:14 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c" returned: 0 in 0.672s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:14 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c Apr 29 09:16:14 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:14 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c" returned: 0 in 0.586s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c" released by "delete_volume" :: held 1.296s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created reservations ['9f30127c-1575-473c-ba19-d78a510dcdad', 'bb28667b-0b50-4120-bd42-fc0ec10c8331', 'ea4c3fe8-1cc0-425d-ab51-25dea53ca9f8', '7b79fc1c-49ae-4229-bc89-e047480af883'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:14 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:14 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:15 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.555s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:15 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Deleted volume successfully. Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d25c5fc5-9e68-475c-a3dd-9a498ef1c062 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-5a5b8f66-d7f6-4e07-bb48-a604f9c2229c-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-e5f2cd69-eff2-4dbc-8878-26c4c25a906b-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-e5f2cd69-eff2-4dbc-8878-26c4c25a906b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "cinder-quobyte-e5f2cd69-eff2-4dbc-8878-26c4c25a906b" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-e5f2cd69-eff2-4dbc-8878-26c4c25a906b" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f009f8-656a-4663-89e4-53c9880e6c55]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:15 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b Apr 29 09:16:15 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:16 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b" returned: 0 in 0.681s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:16 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b Apr 29 09:16:16 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:16 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e5f2cd69-eff2-4dbc-8878-26c4c25a906b" returned: 0 in 0.572s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-quobyte-e5f2cd69-eff2-4dbc-8878-26c4c25a906b" released by "delete_volume" :: held 1.290s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Created reservations ['ad41a593-b51f-4aa5-b4e2-bac52f67af1a', '67d95b9f-b403-4d9d-8f08-4ec35654459b', 'c4321a73-71a5-4fa8-a5a9-12e357a97755', '81a1d2eb-965a-4cda-833d-f0e1da75867e'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:17 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:17 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:17 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.563s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Deleted volume successfully. Apr 29 09:16:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8f869bf7-c076-4434-85ae-97e6022f3bf1 tempest-CreateVolumesFromSourceVolumeTest-104075291 None] Lock "cinder-e5f2cd69-eff2-4dbc-8878-26c4c25a906b-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:27 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=58,cinder:SELECT=43,cinder:INSERT=16,cinder:DELETE=5 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:16:27 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:DELETE=7,cinder:SELECT=32,cinder:UPDATE=65,cinder:INSERT=12 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (04f2881e-749a-43ea-ad6b-bee22a183f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6356afd-0ca1-4bc8-9a24-7877ad14603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6356afd-0ca1-4bc8-9a24-7877ad14603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178624301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6d9a66-3781-4b2d-b513-10fc579cfc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:28Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86ce63e-2c5e-4828-ae59-862d1199805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86ce63e-2c5e-4828-ae59-862d1199805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750e4d58-010e-41c0-aac0-212a07c1a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750e4d58-010e-41c0-aac0-212a07c1a22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6d9a66-3781-4b2d-b513-10fc579cfc01', 'volume_name': 'volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7c2c90-0e0f-4d77-881e-0350bb0255d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7c2c90-0e0f-4d77-881e-0350bb0255d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1fbec8-ac61-4b6b-a790-2634c0b961e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Volume 3e6d9a66-3781-4b2d-b513-10fc579cfc01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01', 'volume_size': 1} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178624301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6d9a66-3781-4b2d-b513-10fc579cfc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:28Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Creating volume 3e6d9a66-3781-4b2d-b513-10fc579cfc01 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:28 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:28 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 1073741824 Apr 29 09:16:28 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (a3b31dd8-9b12-4703-a9a9-2f113e398357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3201d74-d7ba-49b5-af6c-cc000d1fe2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3201d74-d7ba-49b5-af6c-cc000d1fe2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291988315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804ccd2b-8abf-476b-9406-8112dcf92235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:29Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09666059-a9f5-442d-93a5-e4850562a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09666059-a9f5-442d-93a5-e4850562a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d572856b-c79b-45bb-bbc5-19e732ac36dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d572856b-c79b-45bb-bbc5-19e732ac36dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '804ccd2b-8abf-476b-9406-8112dcf92235', 'volume_name': 'volume-804ccd2b-8abf-476b-9406-8112dcf92235', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a93fb5-ee9e-43b8-8e13-551f26fb3e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a93fb5-ee9e-43b8-8e13-551f26fb3e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5704b9a8-7daa-4fc3-94ad-e59647894c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:28 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume 804ccd2b-8abf-476b-9406-8112dcf92235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-804ccd2b-8abf-476b-9406-8112dcf92235', 'volume_size': 1} Apr 29 09:16:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (165dc4b1-64f7-4182-ac7b-c6a744d30ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45dc3a0-abc5-4dfa-993d-8bf3ca6920e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45dc3a0-abc5-4dfa-993d-8bf3ca6920e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-860163419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73e08b2-bf90-405c-9e08-3deaac206fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2adf22c05f95484d8ae57ee004e4fadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:29Z,use_quota=True,user_id='d549650f6aae4d30a5ba1432145069b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9853775c-c676-48cc-8c62-51f79186d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9853775c-c676-48cc-8c62-51f79186d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7e3e30-1be4-4954-a578-071e073d0006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7e3e30-1be4-4954-a578-071e073d0006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73e08b2-bf90-405c-9e08-3deaac206fb7', 'volume_name': 'volume-b73e08b2-bf90-405c-9e08-3deaac206fb7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcae309-9eda-411c-b8d5-abb771c9e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcae309-9eda-411c-b8d5-abb771c9e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67678d6c-5cb6-4368-b515-63413a9e165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Volume b73e08b2-bf90-405c-9e08-3deaac206fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73e08b2-bf90-405c-9e08-3deaac206fb7', 'volume_size': 1} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (adaa53c3-3b77-4db2-8435-937845c8b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c794822f-10a4-4dc6-ba10-69e9091ec00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c794822f-10a4-4dc6-ba10-69e9091ec00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128660089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b30dbe5-867e-4eb0-89bc-c7aac767b55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:29Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5a7d7d-bb12-455f-a74e-617606d66be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5a7d7d-bb12-455f-a74e-617606d66be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157fe875-df4e-4d85-906b-257fc83ac242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157fe875-df4e-4d85-906b-257fc83ac242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b30dbe5-867e-4eb0-89bc-c7aac767b55b', 'volume_name': 'volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0feb002-59a7-47fc-b29e-30c5812c2c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0feb002-59a7-47fc-b29e-30c5812c2c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a47297-2a48-4254-b9a8-8a7c2448851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Volume 3b30dbe5-867e-4eb0-89bc-c7aac767b55b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b', 'volume_size': 1} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (4c7a46d9-d801-441c-8133-043f9e7d60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f6f032-8bf6-4357-b0be-fdafd3012827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f6f032-8bf6-4357-b0be-fdafd3012827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-735911727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:30Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c8673b-5616-4457-8f77-c8078fb914d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c8673b-5616-4457-8f77-c8078fb914d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755fbf74-6dd6-4299-9db0-3be75707c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755fbf74-6dd6-4299-9db0-3be75707c489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e', 'volume_name': 'volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe28675e-7e67-4c8b-b55c-962fff61f60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe28675e-7e67-4c8b-b55c-962fff61f60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:29 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb69bd2-319d-4d5e-a995-bea2cec25ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:29 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Volume a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e', 'volume_size': 1} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 1073741824" returned: 0 in 1.169s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:29 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 Apr 29 09:16:29 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (b8a5f373-dbb4-466f-a4a5-681804bd6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8dba25-e87e-440c-a091-d9dc8266e276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8dba25-e87e-440c-a091-d9dc8266e276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1325229467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db93dbcd-6ea9-4d10-b250-525d701432ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:30Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b1dc82-3754-4f46-b3be-df602fcfd7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b1dc82-3754-4f46-b3be-df602fcfd7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cf77f3-59b1-4a8e-bebc-16038c468318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cf77f3-59b1-4a8e-bebc-16038c468318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db93dbcd-6ea9-4d10-b250-525d701432ee', 'volume_name': 'volume-db93dbcd-6ea9-4d10-b250-525d701432ee', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0fd944-8a0d-4c67-9363-8a5f68a7cd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0fd944-8a0d-4c67-9363-8a5f68a7cd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621b14ab-6944-45bd-812c-be4832174641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Volume db93dbcd-6ea9-4d10-b250-525d701432ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db93dbcd-6ea9-4d10-b250-525d701432ee', 'volume_size': 1} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (ab1fda65-507b-4b78-89ed-07775061f1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2abb3d4-e4c2-4164-9b1f-7798674cd253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2abb3d4-e4c2-4164-9b1f-7798674cd253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070505195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c73392f-bd68-4ef0-b2f3-d5850d63ff51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:31Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206036d-f999-46c7-9f21-6d74dce0c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206036d-f999-46c7-9f21-6d74dce0c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98f5313-f278-4680-afc7-4114acee5e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98f5313-f278-4680-afc7-4114acee5e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c73392f-bd68-4ef0-b2f3-d5850d63ff51', 'volume_name': 'volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3612d49d-20a9-417d-8395-996756ff7bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3612d49d-20a9-417d-8395-996756ff7bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1218793-edc6-4352-a4f1-88d26c13a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Volume 3c73392f-bd68-4ef0-b2f3-d5850d63ff51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51', 'volume_size': 1} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01" returned: 0 in 0.735s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291988315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804ccd2b-8abf-476b-9406-8112dcf92235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:29Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Creating volume 804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:30 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:30 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 1073741824 Apr 29 09:16:30 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1fbec8-ac61-4b6b-a790-2634c0b961e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09d7d82-b8ba-47d8-a62e-475bde5a31ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:30 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Volume volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 (3e6d9a66-3781-4b2d-b513-10fc579cfc01): created successfully Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09d7d82-b8ba-47d8-a62e-475bde5a31ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:30 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (04f2881e-749a-43ea-ad6b-bee22a183f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:30 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-002b9ef1-f55f-4451-bede-e61a3348bbce tempest-CreateVolumesFromImageTest-135400206 None] Created volume successfully. Apr 29 09:16:31 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 1073741824" returned: 0 in 0.822s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:31 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 Apr 29 09:16:31 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:32 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235" returned: 0 in 0.579s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-860163419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73e08b2-bf90-405c-9e08-3deaac206fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2adf22c05f95484d8ae57ee004e4fadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:29Z,use_quota=True,user_id='d549650f6aae4d30a5ba1432145069b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Creating volume b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:32 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5704b9a8-7daa-4fc3-94ad-e59647894c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804ccd2b-8abf-476b-9406-8112dcf92235', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:32 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 1073741824 Apr 29 09:16:32 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b5d2bc-7818-456d-b3f9-31a50d0a9280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:32 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume volume-804ccd2b-8abf-476b-9406-8112dcf92235 (804ccd2b-8abf-476b-9406-8112dcf92235): created successfully Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b5d2bc-7818-456d-b3f9-31a50d0a9280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (a3b31dd8-9b12-4703-a9a9-2f113e398357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-66d8c42c-2454-4b9a-8a2b-32f11de1b89d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created volume successfully. Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:32 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 1073741824" returned: 0 in 0.848s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:32 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 Apr 29 09:16:32 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:33 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7" returned: 0 in 0.679s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.264s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128660089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b30dbe5-867e-4eb0-89bc-c7aac767b55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:29Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Creating volume 3b30dbe5-867e-4eb0-89bc-c7aac767b55b {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:33 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:33 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b 1073741824 Apr 29 09:16:33 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67678d6c-5cb6-4368-b515-63413a9e165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73e08b2-bf90-405c-9e08-3deaac206fb7', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6c05a7-222a-4668-91a7-8bbd00ca6fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:33 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Volume volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 (b73e08b2-bf90-405c-9e08-3deaac206fb7): created successfully Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6c05a7-222a-4668-91a7-8bbd00ca6fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:33 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (165dc4b1-64f7-4182-ac7b-c6a744d30ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b44e616a-3cf6-4090-bdac-7b4f11c70143 tempest-VolumeDependencyTests-1381849232 None] Created volume successfully. Apr 29 09:16:34 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b 1073741824" returned: 0 in 0.826s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:34 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b Apr 29 09:16:34 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:35 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b" returned: 0 in 0.650s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.329s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-735911727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:30Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Creating volume a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:35 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:35 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e 1073741824 Apr 29 09:16:35 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a47297-2a48-4254-b9a8-8a7c2448851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc17d2e8-557b-44ee-8e0b-c25aa8005d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:35 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Volume volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b (3b30dbe5-867e-4eb0-89bc-c7aac767b55b): created successfully Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc17d2e8-557b-44ee-8e0b-c25aa8005d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:35 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (adaa53c3-3b77-4db2-8435-937845c8b411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:35 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-cbe49250-d84c-49a8-939f-8272ae4798cb tempest-CreateVolumesFromImageTest-135400206 None] Created volume successfully. Apr 29 09:16:36 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e 1073741824" returned: 0 in 0.896s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:36 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e Apr 29 09:16:36 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:36 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e" returned: 0 in 0.574s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.451s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1325229467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db93dbcd-6ea9-4d10-b250-525d701432ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:30Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Creating volume db93dbcd-6ea9-4d10-b250-525d701432ee {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:36 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:36 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee 1073741824 Apr 29 09:16:36 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb69bd2-319d-4d5e-a995-bea2cec25ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39693714-6536-449c-9cf0-dfba1a6ccbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:36 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Volume volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e (a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e): created successfully Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39693714-6536-449c-9cf0-dfba1a6ccbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:36 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (4c7a46d9-d801-441c-8133-043f9e7d60cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:36 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2edef5f6-afeb-4b89-a85e-34a3ca8df1c4 tempest-CreateVolumesFromImageTest-135400206 None] Created volume successfully. Apr 29 09:16:37 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee 1073741824" returned: 0 in 0.849s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:37 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee Apr 29 09:16:37 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:38 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee" returned: 0 in 0.636s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.609s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070505195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c73392f-bd68-4ef0-b2f3-d5850d63ff51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed21ff132ba54ae18da681cfad753b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:31Z,use_quota=True,user_id='6638be9d1d54493d88574e3d188a2bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Creating volume 3c73392f-bd68-4ef0-b2f3-d5850d63ff51 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:38 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621b14ab-6944-45bd-812c-be4832174641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db93dbcd-6ea9-4d10-b250-525d701432ee', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f58689e-25de-4be4-910e-7f20478fd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:38 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 1073741824 Apr 29 09:16:38 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:38 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Volume volume-db93dbcd-6ea9-4d10-b250-525d701432ee (db93dbcd-6ea9-4d10-b250-525d701432ee): created successfully Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f58689e-25de-4be4-910e-7f20478fd687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:38 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (b8a5f373-dbb4-466f-a4a5-681804bd6192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:38 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0fe12cac-92d4-4c24-853f-013148797922 tempest-CreateVolumesFromImageTest-135400206 None] Created volume successfully. Apr 29 09:16:39 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 1073741824" returned: 0 in 0.927s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:39 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 Apr 29 09:16:39 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:39 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51" returned: 0 in 0.629s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.394s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1218793-edc6-4352-a4f1-88d26c13a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcf92ec-86e0-4234-9001-9b036becadd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Creating offline snapshot e84f77c2-8c7f-421b-bfdb-e163bcc2b451 of volume 804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:16:39 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Volume volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 (3c73392f-bd68-4ef0-b2f3-d5850d63ff51): created successfully Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcf92ec-86e0-4234-9001-9b036becadd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Flow 'volume_create_manager' (ab1fda65-507b-4b78-89ed-07775061f1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fbe2fd-1a2b-47c1-b60f-348d31bf6614]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:39 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:39 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-71408a0d-bf00-436e-8a36-473cd6dadb00 tempest-CreateVolumesFromImageTest-135400206 None] Created volume successfully. Apr 29 09:16:40 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 Apr 29 09:16:40 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-3c73392f-bd68-4ef0-b2f3-d5850d63ff51-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-3c73392f-bd68-4ef0-b2f3-d5850d63ff51-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-quobyte-3c73392f-bd68-4ef0-b2f3-d5850d63ff51" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-3c73392f-bd68-4ef0-b2f3-d5850d63ff51" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af65a46-6319-4db9-9100-01fe1a02214e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:40 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235" returned: 0 in 0.808s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:40 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 Apr 29 09:16:40 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:40 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 1G Apr 29 09:16:40 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:41 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51" returned: 0 in 0.808s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:41 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51 Apr 29 09:16:41 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:41 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 1G" returned: 0 in 0.870s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804ccd2b-8abf-476b-9406-8112dcf92235 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:41 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804ccd2b-8abf-476b-9406-8112dcf92235 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 Apr 29 09:16:41 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:42 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3c73392f-bd68-4ef0-b2f3-d5850d63ff51" returned: 0 in 0.657s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-3c73392f-bd68-4ef0-b2f3-d5850d63ff51" released by "delete_volume" :: held 1.515s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Created reservations ['2c333456-e416-4197-b049-ba544a2701ca', '7266d7ff-dcc4-458e-935f-5e004295b28e', '137cb384-a422-464e-8f36-0ca6631ba6e4', 'f18cd314-decc-42ce-aa76-055cbfc275a2'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:42 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:42 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:42 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804ccd2b-8abf-476b-9406-8112dcf92235 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451" returned: 0 in 0.743s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:42 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 is being set with open permissions: ugo+rw Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:42 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 Apr 29 09:16:42 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-db93dbcd-6ea9-4d10-b250-525d701432ee-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-db93dbcd-6ea9-4d10-b250-525d701432ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-quobyte-db93dbcd-6ea9-4d10-b250-525d701432ee" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-db93dbcd-6ea9-4d10-b250-525d701432ee" acquired by "delete_volume" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8d779-48fa-4c6f-9069-eae02907de08]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:42 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.731s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:43 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Deleted volume successfully. Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-994bb85e-c655-49d2-a012-fbfda5a28cea tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-3c73392f-bd68-4ef0-b2f3-d5850d63ff51-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:43 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451" returned: 0 in 0.752s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:43 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee Apr 29 09:16:43 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:43 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.info Apr 29 09:16:43 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:43 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.info" returned: 0 in 0.628s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:43 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.info is being set with open permissions: ugo+rw Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:43 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee" returned: 0 in 0.814s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:43 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.info Apr 29 09:16:43 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:43 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee Apr 29 09:16:43 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:44 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.info" returned: 0 in 0.651s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.580s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.752s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Creating offline snapshot b1c54f31-db7f-4706-9670-db9718a098a9 of volume b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:16:44 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-db93dbcd-6ea9-4d10-b250-525d701432ee" returned: 0 in 0.700s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb20ec38-0af5-4ee7-b20d-2be9693e8114]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:44 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9990b0b3-d34d-4510-95c5-a586d3116482 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Create snapshot completed successfully Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-db93dbcd-6ea9-4d10-b250-525d701432ee" released by "delete_volume" :: held 1.596s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Created reservations ['2681cc92-5a1b-449f-bab7-b56ab3d76368', '3c8b77d4-4f15-4287-bfd3-60b1ce64ecf5', '11112d41-3324-4485-98b6-748b2bf1d98d', 'f5c73a86-aec3-4a33-afe9-2f66922e227f'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:44 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 Apr 29 09:16:44 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:44 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:44 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-quobyte-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b5d4d8-611f-4069-aef5-39a2f028a52e]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:45 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.897s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:45 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e Apr 29 09:16:45 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:45 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Deleted volume successfully. Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-31fa0a0b-5615-4c6c-b7b6-449c79eb68ab tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-db93dbcd-6ea9-4d10-b250-525d701432ee-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:45 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7" returned: 0 in 1.274s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:45 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 1G Apr 29 09:16:45 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:45 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (c2e066cd-821c-447d-8508-baeb99e7fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dc0d50-a172-4b6b-a0b0-a8310d3393b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dc0d50-a172-4b6b-a0b0-a8310d3393b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144549304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c95226f-80f9-4b96-8ac4-808f5fc67c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:46Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc76d89-c5af-4346-9370-eabe2519b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc76d89-c5af-4346-9370-eabe2519b17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa287d7-bb80-441b-b7fa-0761cbbbef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa287d7-bb80-441b-b7fa-0761cbbbef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c95226f-80f9-4b96-8ac4-808f5fc67c4d', 'volume_name': 'volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0998358-c0da-4210-afec-d2702e57b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0998358-c0da-4210-afec-d2702e57b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12856e83-6d07-4f0f-86d0-368826364651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume 8c95226f-80f9-4b96-8ac4-808f5fc67c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d', 'volume_size': 1} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (929eac5c-1fc7-4a9e-88b5-5c9374738e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f10bd9-7c37-4b12-81cc-e266a6046bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f10bd9-7c37-4b12-81cc-e266a6046bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650310596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4c0a54-a9b0-46d5-a42c-3f50834b9502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:46Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0d52ce-cabc-40ee-b197-ed44b65b3326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0d52ce-cabc-40ee-b197-ed44b65b3326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206dcb87-8bff-4ed3-b00b-1b52a1122133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206dcb87-8bff-4ed3-b00b-1b52a1122133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4c0a54-a9b0-46d5-a42c-3f50834b9502', 'volume_name': 'volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1a6a65-19c2-40c1-a41f-adcae15cc20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1a6a65-19c2-40c1-a41f-adcae15cc20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05307f7-7673-4bc3-abfa-34e532653835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:46 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume fc4c0a54-a9b0-46d5-a42c-3f50834b9502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502', 'volume_size': 1} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e" returned: 0 in 1.188s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:46 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e Apr 29 09:16:46 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:47 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 1G" returned: 0 in 1.237s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:47 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 Apr 29 09:16:47 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (04fc3af6-3633-4da6-85b5-b6478dd191fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabb054f-3091-4fef-82ed-66b617f6f483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabb054f-3091-4fef-82ed-66b617f6f483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1941689076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57b7888-c357-4617-8c62-b1320271cc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:47Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d59dcbe-7450-455e-a353-fe1d7c1894fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d59dcbe-7450-455e-a353-fe1d7c1894fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6857911b-abd9-4d0d-b226-5e061c9c325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6857911b-abd9-4d0d-b226-5e061c9c325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57b7888-c357-4617-8c62-b1320271cc6d', 'volume_name': 'volume-b57b7888-c357-4617-8c62-b1320271cc6d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0d329b-d115-443b-b95c-2f2999a75a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0d329b-d115-443b-b95c-2f2999a75a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f125f7-77aa-48a1-8b65-9287877f56b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume b57b7888-c357-4617-8c62-b1320271cc6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57b7888-c357-4617-8c62-b1320271cc6d', 'volume_size': 1} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:47 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e" returned: 0 in 0.933s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e" released by "delete_volume" :: held 2.249s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Created reservations ['57bd3e19-85c2-4d62-a382-4cf9690f4f35', '10822423-afef-4e0b-99a0-4bc4471b6dc1', '5c3c9d8a-c9db-45aa-9764-c28a74acfcb2', '4f0ea0e0-eaa4-4e18-9c80-9513b78bf738'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:47 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:47 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (accea6b1-e762-45e4-ab7c-1055a22b7dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3864d-71db-465f-b0ad-d12c4606201d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3864d-71db-465f-b0ad-d12c4606201d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136745231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0e7494-f31e-4863-8caf-679599dd3994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:48Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b31f3e-c1a5-4ca8-964c-947b2ad3028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b31f3e-c1a5-4ca8-964c-947b2ad3028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70ba472-3040-42c9-984d-4347cddc3eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70ba472-3040-42c9-984d-4347cddc3eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0e7494-f31e-4863-8caf-679599dd3994', 'volume_name': 'volume-cc0e7494-f31e-4863-8caf-679599dd3994', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c54736-6f8d-4c0b-bfca-469d946ebf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c54736-6f8d-4c0b-bfca-469d946ebf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3b69a0-a2ca-4e20-bc30-0246a63f2c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:47 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume cc0e7494-f31e-4863-8caf-679599dd3994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0e7494-f31e-4863-8caf-679599dd3994', 'volume_size': 1} Apr 29 09:16:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:48 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9" returned: 0 in 1.103s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:48 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 is being set with open permissions: ugo+rw Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:48 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 Apr 29 09:16:48 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (2bfd5a85-0035-40d3-bc2e-5789de9122f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e20727-dc3a-4a7f-9020-05e4b0a8744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e20727-dc3a-4a7f-9020-05e4b0a8744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369900193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c92511-9514-4031-b3fa-5eaab89a1df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:48Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca856c5-3ea3-4d75-9465-1dbf8f029bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca856c5-3ea3-4d75-9465-1dbf8f029bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5badfd27-5a7e-4e9d-9fa2-37cd6de437a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5badfd27-5a7e-4e9d-9fa2-37cd6de437a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c92511-9514-4031-b3fa-5eaab89a1df8', 'volume_name': 'volume-07c92511-9514-4031-b3fa-5eaab89a1df8', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c601da6-da7b-409c-bfdc-b8e9241129d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c601da6-da7b-409c-bfdc-b8e9241129d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9ed347-e60e-4e66-9693-6ac1dbb2c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:48 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume 07c92511-9514-4031-b3fa-5eaab89a1df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c92511-9514-4031-b3fa-5eaab89a1df8', 'volume_size': 1} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-3b30dbe5-867e-4eb0-89bc-c7aac767b55b-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-3b30dbe5-867e-4eb0-89bc-c7aac767b55b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:48 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.003s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:48 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Deleted volume successfully. Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-quobyte-3b30dbe5-867e-4eb0-89bc-c7aac767b55b" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-db62eafb-8abf-46a4-b7d7-683fc7a7e7e7 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-a1039f81-bdc4-4b76-8b6f-3aa7b9863f9e-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-3b30dbe5-867e-4eb0-89bc-c7aac767b55b" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37b015-41bf-4504-ad60-77762add1306]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:49 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9" returned: 0 in 0.886s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:49 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b Apr 29 09:16:49 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:49 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.info Apr 29 09:16:49 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:49 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.info" returned: 0 in 0.638s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:49 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.info is being set with open permissions: ugo+rw Apr 29 09:16:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:49 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:49 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.info Apr 29 09:16:49 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b" returned: 0 in 0.821s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:49 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b Apr 29 09:16:49 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:50 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.info" returned: 0 in 0.629s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.906s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.235s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144549304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c95226f-80f9-4b96-8ac4-808f5fc67c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:46Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Creating volume 8c95226f-80f9-4b96-8ac4-808f5fc67c4d {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:50 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:50 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b30dbe5-867e-4eb0-89bc-c7aac767b55b" returned: 0 in 0.671s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:50 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d 1073741824 Apr 29 09:16:50 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-3b30dbe5-867e-4eb0-89bc-c7aac767b55b" released by "delete_volume" :: held 1.565s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:50 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3bcc8525-2beb-40ed-bce3-4357f0bee2d2 tempest-VolumeDependencyTests-1381849232 None] Create snapshot completed successfully Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Created reservations ['2deb5040-dc1d-4ed9-8138-03603abfe956', '2058a75b-1345-4fb7-b0f0-d17840124156', '48a2a9a2-ed48-49cc-94b6-e754704b0c06', 'af26c156-4e3d-405a-94f7-856f4530c1ee'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:50 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:50 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-3e6d9a66-3781-4b2d-b513-10fc579cfc01-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-3e6d9a66-3781-4b2d-b513-10fc579cfc01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "cinder-quobyte-3e6d9a66-3781-4b2d-b513-10fc579cfc01" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-3e6d9a66-3781-4b2d-b513-10fc579cfc01" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e41068-fe77-42c6-8619-01f2e63e9673]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:51 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 Apr 29 09:16:51 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:51 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.782s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:51 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Deleted volume successfully. Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-1cb697ad-6fba-40f3-aa3e-7c7e4ffd1a16 tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-3b30dbe5-867e-4eb0-89bc-c7aac767b55b-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:51 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d 1073741824" returned: 0 in 1.192s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:51 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d Apr 29 09:16:51 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (9e9c9cf7-8f30-4484-8600-5ee7095edf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d92ff1-5c0e-4b83-8268-9611301213a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d92ff1-5c0e-4b83-8268-9611301213a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1001489158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce8e024-21ef-4c71-a973-953bc182a83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2adf22c05f95484d8ae57ee004e4fadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1c54f31-db7f-4706-9670-db9718a098a9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:52Z,use_quota=True,user_id='d549650f6aae4d30a5ba1432145069b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7173de-c0bf-40bb-9eef-38db471a2a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7173de-c0bf-40bb-9eef-38db471a2a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b2c5e4-0b32-4610-8b57-c652c64b38fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b2c5e4-0b32-4610-8b57-c652c64b38fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ce8e024-21ef-4c71-a973-953bc182a83f', 'volume_name': 'volume-8ce8e024-21ef-4c71-a973-953bc182a83f', 'volume_size': 1, 'snapshot_id': 'b1c54f31-db7f-4706-9670-db9718a098a9'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fa9daa-86a9-43af-a826-273745b55688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fa9daa-86a9-43af-a826-273745b55688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98bc098-9f1c-44b5-bf81-1690167b02dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Volume 8ce8e024-21ef-4c71-a973-953bc182a83f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ce8e024-21ef-4c71-a973-953bc182a83f', 'volume_size': 1, 'snapshot_id': 'b1c54f31-db7f-4706-9670-db9718a098a9'} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:52 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Flow 'volume_create_manager' (0a15f9f5-427d-43d6-935b-1813d55b0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd002585-9ea0-44da-b0ad-419cae54ea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01" returned: 0 in 0.997s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:52 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01 Apr 29 09:16:52 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd002585-9ea0-44da-b0ad-419cae54ea77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-532669082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279c332d-a008-4787-97eb-a9337db6e62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da9e500906e4cd0bca411b7a0a0f802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:52Z,use_quota=True,user_id='e4d5e0c24e004e31bbbd6808f521a737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18ee0cc-c705-49a9-bbd8-510cf9b10ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18ee0cc-c705-49a9-bbd8-510cf9b10ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733e484b-219b-48a6-8404-730aff88679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733e484b-219b-48a6-8404-730aff88679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279c332d-a008-4787-97eb-a9337db6e62a', 'volume_name': 'volume-279c332d-a008-4787-97eb-a9337db6e62a', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2649df-8e36-40f5-99b0-baf0202866d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2649df-8e36-40f5-99b0-baf0202866d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc846f5-7aaa-4e28-9f72-7f33ba92330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Volume 279c332d-a008-4787-97eb-a9337db6e62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279c332d-a008-4787-97eb-a9337db6e62a', 'volume_size': 1} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:52 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d" returned: 0 in 0.772s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.749s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650310596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4c0a54-a9b0-46d5-a42c-3f50834b9502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:46Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Creating volume fc4c0a54-a9b0-46d5-a42c-3f50834b9502 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:52 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12856e83-6d07-4f0f-86d0-368826364651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 1073741824 Apr 29 09:16:52 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10f0235-d956-4035-b8a5-f6c6d9986c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:52 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d (8c95226f-80f9-4b96-8ac4-808f5fc67c4d): created successfully Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10f0235-d956-4035-b8a5-f6c6d9986c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (c2e066cd-821c-447d-8508-baeb99e7fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:52 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9fc6f6e7-5529-48f6-8f79-cf610d7fd8a8 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created volume successfully. Apr 29 09:16:52 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3e6d9a66-3781-4b2d-b513-10fc579cfc01" returned: 0 in 0.643s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-quobyte-3e6d9a66-3781-4b2d-b513-10fc579cfc01" released by "delete_volume" :: held 1.696s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:52 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Created reservations ['d830149d-42d9-4923-9317-27bbda25a2f7', '75ab5278-2897-4137-ab6c-23696fe98898', 'fa0956b0-9baa-4f1c-96f5-d70f88ea1dc4', '56df826c-3b8e-404a-b7f4-4a0726b5435a'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:53 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:16:53 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:53 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 1073741824" returned: 0 in 0.818s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:53 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 Apr 29 09:16:53 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:53 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.631s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:16:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Deleted volume successfully. Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-0cfea18d-0aad-4f13-b2d0-79dbd73aef2d tempest-CreateVolumesFromImageTest-135400206 None] Lock "cinder-3e6d9a66-3781-4b2d-b513-10fc579cfc01-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:16:53 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502" returned: 0 in 0.658s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.592s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1941689076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57b7888-c357-4617-8c62-b1320271cc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:47Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Creating volume b57b7888-c357-4617-8c62-b1320271cc6d {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:53 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05307f7-7673-4bc3-abfa-34e532653835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:53 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d 1073741824 Apr 29 09:16:53 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd3f93d-9000-4ecd-914d-6d71eda25e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:53 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 (fc4c0a54-a9b0-46d5-a42c-3f50834b9502): created successfully Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd3f93d-9000-4ecd-914d-6d71eda25e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (929eac5c-1fc7-4a9e-88b5-5c9374738e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-fc22ebe2-7b80-4a87-88a2-31f6303ddceb tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created volume successfully. Apr 29 09:16:54 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d 1073741824" returned: 0 in 0.900s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:54 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d Apr 29 09:16:54 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:55 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d" returned: 0 in 0.596s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.511s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136745231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0e7494-f31e-4863-8caf-679599dd3994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:48Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Creating volume cc0e7494-f31e-4863-8caf-679599dd3994 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:55 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f125f7-77aa-48a1-8b65-9287877f56b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57b7888-c357-4617-8c62-b1320271cc6d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5abe41-1f72-42d6-b5ae-294fc797b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:55 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 1073741824 Apr 29 09:16:55 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:55 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume volume-b57b7888-c357-4617-8c62-b1320271cc6d (b57b7888-c357-4617-8c62-b1320271cc6d): created successfully Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5abe41-1f72-42d6-b5ae-294fc797b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:55 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (04fc3af6-3633-4da6-85b5-b6478dd191fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:55 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d8f752e5-4906-4d69-b8ce-dd0eef9c8bae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created volume successfully. Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Flow 'volume_create_manager' (5188f9c0-33da-4257-964a-99aa2be0e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e524e4f9-7056-4128-a539-e655837c9ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e524e4f9-7056-4128-a539-e655837c9ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f88179-ef01-4266-87f1-87b664be8350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e518fcbc5454887b13f15ba94ef8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:56Z,use_quota=True,user_id='393a628a71f14f7991ab7d7bdb30e05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5201865d-4127-417f-9480-2a11dbec1f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5201865d-4127-417f-9480-2a11dbec1f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a1664d-475b-4294-9f40-70733257f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a1664d-475b-4294-9f40-70733257f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f88179-ef01-4266-87f1-87b664be8350', 'volume_name': 'volume-b0f88179-ef01-4266-87f1-87b664be8350', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f15a8b-de17-46d8-a797-91550252a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f15a8b-de17-46d8-a797-91550252a567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93b7e30-51e7-41b2-a7f2-962838c65c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:56 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Volume b0f88179-ef01-4266-87f1-87b664be8350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f88179-ef01-4266-87f1-87b664be8350', 'volume_size': 1} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:56 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 1073741824" returned: 0 in 0.935s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:56 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 Apr 29 09:16:56 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:57 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994" returned: 0 in 0.572s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.551s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369900193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c92511-9514-4031-b3fa-5eaab89a1df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd398b514bb4e27a833e482eddf68f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:48Z,use_quota=True,user_id='ec12db53be2947c3af9640059e30a5d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Creating volume 07c92511-9514-4031-b3fa-5eaab89a1df8 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:57 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:57 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 1073741824 Apr 29 09:16:57 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3b69a0-a2ca-4e20-bc30-0246a63f2c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0e7494-f31e-4863-8caf-679599dd3994', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3280ed-685b-4ffe-99cb-4029b585217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:57 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume volume-cc0e7494-f31e-4863-8caf-679599dd3994 (cc0e7494-f31e-4863-8caf-679599dd3994): created successfully Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3280ed-685b-4ffe-99cb-4029b585217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (accea6b1-e762-45e4-ab7c-1055a22b7dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:57 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-6372126d-0222-4475-8a64-bb1df2e483d6 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created volume successfully. Apr 29 09:16:57 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 1073741824" returned: 0 in 0.751s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:57 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 Apr 29 09:16:57 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:58 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8" returned: 0 in 0.599s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.179s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-b1c54f31-db7f-4706-9670-db9718a098a9-8ce8e024-21ef-4c71-a973-953bc182a83f" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9ed347-e60e-4e66-9693-6ac1dbb2c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c92511-9514-4031-b3fa-5eaab89a1df8', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5bdd1f-c926-4902-8691-3556dafd98d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b1c54f31-db7f-4706-9670-db9718a098a9-8ce8e024-21ef-4c71-a973-953bc182a83f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Creating volume 8ce8e024-21ef-4c71-a973-953bc182a83f from snapshot b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-8ce8e024-21ef-4c71-a973-953bc182a83f" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-8ce8e024-21ef-4c71-a973-953bc182a83f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] snapshot: b1c54f31-db7f-4706-9670-db9718a098a9, volume: 8ce8e024-21ef-4c71-a973-953bc182a83f, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:16:58 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Volume volume-07c92511-9514-4031-b3fa-5eaab89a1df8 (07c92511-9514-4031-b3fa-5eaab89a1df8): created successfully Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5bdd1f-c926-4902-8691-3556dafd98d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Flow 'volume_create_manager' (2bfd5a85-0035-40d3-bc2e-5789de9122f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:16:58 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-a189b881-6f52-4876-bb08-e39aa8a2e602 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created volume successfully. Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb9d7ee-ff8d-4882-9c1a-dd59860a7c15]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:58 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 Apr 29 09:16:58 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-07c92511-9514-4031-b3fa-5eaab89a1df8-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-07c92511-9514-4031-b3fa-5eaab89a1df8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-07c92511-9514-4031-b3fa-5eaab89a1df8" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-07c92511-9514-4031-b3fa-5eaab89a1df8" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[660c0f3f-efaa-4304-a86b-4d9008cf0750]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:58 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 Apr 29 09:16:58 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:59 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9" returned: 0 in 0.724s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73e08b2-bf90-405c-9e08-3deaac206fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[73573009-db66-4c92-81a9-8bf6d3b709d5]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:59 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 Apr 29 09:16:59 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:16:59 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8" returned: 0 in 0.706s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:16:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:16:59 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8 Apr 29 09:16:59 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:00 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7" returned: 0 in 0.740s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:00 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f Apr 29 09:17:00 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:00 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-07c92511-9514-4031-b3fa-5eaab89a1df8" returned: 0 in 0.592s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-07c92511-9514-4031-b3fa-5eaab89a1df8" released by "delete_volume" :: held 1.338s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created reservations ['466740df-dbfd-4f7f-b67d-524cfad98634', 'a8b16777-5819-4a1b-8a05-4a9fcdff237e', '2fa3bc9c-f063-459d-94bf-45f26d41588a', '2c777f91-8c3e-4ccd-904f-ef8826504594'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:00 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:00 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:00 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.731s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:00 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:00 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Deleted volume successfully. Apr 29 09:17:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-831abd8c-711d-4be7-8fdc-543fa3263aae tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-07c92511-9514-4031-b3fa-5eaab89a1df8-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-cc0e7494-f31e-4863-8caf-679599dd3994-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-cc0e7494-f31e-4863-8caf-679599dd3994-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-cc0e7494-f31e-4863-8caf-679599dd3994" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-cc0e7494-f31e-4863-8caf-679599dd3994" acquired by "delete_volume" :: waited 0.050s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:01 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17cffe3-281c-4b4f-bc61-71d62709e1a4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:01 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 Apr 29 09:17:01 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:17:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:02 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:02 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:03 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994" returned: 0 in 1.764s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:03 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994 Apr 29 09:17:03 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:03 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.333s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:04 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-cc0e7494-f31e-4863-8caf-679599dd3994" returned: 0 in 1.494s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-cc0e7494-f31e-4863-8caf-679599dd3994" released by "delete_volume" :: held 3.350s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created reservations ['c10ffa81-5a33-4b3c-8082-34be9641855d', 'bb1dbf02-7989-4393-a94c-98ed4674bc29', 'b64c8a8b-2fca-4a4c-b815-9e703a3045d1', '1f92495b-413d-4490-81f7-60cd2c7f4fd5'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:04 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:04 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:05 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f" returned: 0 in 5.340s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9319294-70d1-4f2d-9d26-708f916e8031]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:05 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 Apr 29 09:17:05 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:05 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.730s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:05 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Deleted volume successfully. Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-84704ec5-f3a8-47be-8165-f71008783f3d tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-cc0e7494-f31e-4863-8caf-679599dd3994-delete_volume" released by "delete_volume" :: held 4.506s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-b57b7888-c357-4617-8c62-b1320271cc6d-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-b57b7888-c357-4617-8c62-b1320271cc6d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-b57b7888-c357-4617-8c62-b1320271cc6d" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-b57b7888-c357-4617-8c62-b1320271cc6d" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[274b6094-bef3-432d-8000-f5a2ba8bb3b9]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:06 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d Apr 29 09:17:06 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:06 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7" returned: 0 in 0.848s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:17:06 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Converted 1024.00 MB image at 191.70 MB/s Apr 29 09:17:06 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f is being set with open permissions: ugo+rw Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:06 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f Apr 29 09:17:06 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:06 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d" returned: 0 in 0.702s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:06 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d Apr 29 09:17:06 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:06 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f" returned: 0 in 0.563s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-8ce8e024-21ef-4c71-a973-953bc182a83f" released by "_copy_volume_from_snapshot" :: held 8.336s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b1c54f31-db7f-4706-9670-db9718a098a9-8ce8e024-21ef-4c71-a973-953bc182a83f" released by "_create_volume_from_snapshot" :: held 8.379s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.407s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.468s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-532669082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279c332d-a008-4787-97eb-a9337db6e62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da9e500906e4cd0bca411b7a0a0f802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:52Z,use_quota=True,user_id='e4d5e0c24e004e31bbbd6808f521a737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Creating volume 279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:06 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:06 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a 1073741824 Apr 29 09:17:06 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98bc098-9f1c-44b5-bf81-1690167b02dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce8e024-21ef-4c71-a973-953bc182a83f', 'volume_size': 1, 'snapshot_id': 'b1c54f31-db7f-4706-9670-db9718a098a9'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5e1606-4d53-4f8c-a46f-c547a4a00680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:06 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Volume volume-8ce8e024-21ef-4c71-a973-953bc182a83f (8ce8e024-21ef-4c71-a973-953bc182a83f): created successfully Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5e1606-4d53-4f8c-a46f-c547a4a00680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:06 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (9e9c9cf7-8f30-4484-8600-5ee7095edf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-220237d5-4d25-48f8-b1b5-786493dc190f tempest-VolumeDependencyTests-1381849232 None] Created volume successfully. Apr 29 09:17:07 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b57b7888-c357-4617-8c62-b1320271cc6d" returned: 0 in 0.617s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-b57b7888-c357-4617-8c62-b1320271cc6d" released by "delete_volume" :: held 1.357s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created reservations ['4fc97194-e4af-4f7e-9619-8e3a35d5c30f', '2010936b-a52b-4a3a-ab4d-7732c5cf2fc5', 'f98cf8cc-a2b3-4c48-8969-9320262174f2', 'bcbebbcd-bd61-4117-9da6-a06fe917ce17'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:07 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:07 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-b1c54f31-db7f-4706-9670-db9718a098a9-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-b1c54f31-db7f-4706-9670-db9718a098a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-b73e08b2-bf90-405c-9e08-3deaac206fb7" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b73e08b2-bf90-405c-9e08-3deaac206fb7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-b1c54f31-db7f-4706-9670-db9718a098a9" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b1c54f31-db7f-4706-9670-db9718a098a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Deleting offline snapshot b1c54f31-db7f-4706-9670-db9718a098a9 of volume b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] snapshot_file for this snap is: volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba2f280-2278-4062-a3ef-06a04e293fd4]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:07 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a 1073741824" returned: 0 in 0.850s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:07 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 Apr 29 09:17:07 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:07 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a Apr 29 09:17:07 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:08 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.635s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Deleted volume successfully. Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-fc4c0a54-a9b0-46d5-a42c-3f50834b9502-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-d9e999b7-5428-48dc-ae24-ef451013d746 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-b57b7888-c357-4617-8c62-b1320271cc6d-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-fc4c0a54-a9b0-46d5-a42c-3f50834b9502-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-fc4c0a54-a9b0-46d5-a42c-3f50834b9502" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-fc4c0a54-a9b0-46d5-a42c-3f50834b9502" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c75765-4139-443d-9255-72c9c4f67034]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:08 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 Apr 29 09:17:08 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:08 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a" returned: 0 in 0.642s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.033s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f88179-ef01-4266-87f1-87b664be8350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e518fcbc5454887b13f15ba94ef8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:56Z,use_quota=True,user_id='393a628a71f14f7991ab7d7bdb30e05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Creating volume b0f88179-ef01-4266-87f1-87b664be8350 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:08 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:08 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9" returned: 0 in 0.812s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73e08b2-bf90-405c-9e08-3deaac206fb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:17:08 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 1073741824 Apr 29 09:17:08 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc846f5-7aaa-4e28-9f72-7f33ba92330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279c332d-a008-4787-97eb-a9337db6e62a', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f5a1c5-594f-4455-ad3f-f1b62c0398a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9559d61b-a070-4830-bc81-d39f2c49dbfe]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:08 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Volume volume-279c332d-a008-4787-97eb-a9337db6e62a (279c332d-a008-4787-97eb-a9337db6e62a): created successfully Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f5a1c5-594f-4455-ad3f-f1b62c0398a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Flow 'volume_create_manager' (0a15f9f5-427d-43d6-935b-1813d55b0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e61abae6-0e76-4a9f-a61b-07b7d57ac4bf tempest-SnapshotDependencyTests-404261910 None] Created volume successfully. Apr 29 09:17:08 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 Apr 29 09:17:08 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:08 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502" returned: 0 in 0.718s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:08 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502 Apr 29 09:17:08 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:09 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 1073741824" returned: 0 in 0.807s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:09 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7" returned: 0 in 0.766s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:09 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 Apr 29 09:17:09 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:09 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 Apr 29 09:17:09 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:09 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-fc4c0a54-a9b0-46d5-a42c-3f50834b9502" returned: 0 in 0.612s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-fc4c0a54-a9b0-46d5-a42c-3f50834b9502" released by "delete_volume" :: held 1.394s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created reservations ['732609a1-2d83-4a7b-ae53-f57752aeea6d', '56a0edac-9c10-4c26-aa9b-717545f2a304', '38252074-12d8-450d-a2dd-fdf8b4611150', 'd1035659-23c7-4f97-84c4-8a8f04401493'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:09 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:09 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:09 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350" returned: 0 in 0.655s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93b7e30-51e7-41b2-a7f2-962838c65c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f88179-ef01-4266-87f1-87b664be8350', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf65acab-4b9e-43cd-801d-13836edd2552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:09 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Volume volume-b0f88179-ef01-4266-87f1-87b664be8350 (b0f88179-ef01-4266-87f1-87b664be8350): created successfully Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf65acab-4b9e-43cd-801d-13836edd2552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Flow 'volume_create_manager' (5188f9c0-33da-4257-964a-99aa2be0e76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:09 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Creating offline snapshot a73210cd-48ab-4d22-bf86-76ab9321cc42 of volume 279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9" returned: 0 in 0.784s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:09 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2af5741e-a31f-475c-8dd4-d510d0b670a3 tempest-CinderUnicodeTest-1966797194 None] Created volume successfully. Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a301d002-5566-4c08-a1d1-5a0b7889f220]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:10 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9 Apr 29 09:17:10 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:10 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a Apr 29 09:17:10 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:10 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-8c95226f-80f9-4b96-8ac4-808f5fc67c4d-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.736s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-8c95226f-80f9-4b96-8ac4-808f5fc67c4d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Deleted volume successfully. Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-2cfdbbbf-a39a-4074-8a35-b34b119c24f1 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-fc4c0a54-a9b0-46d5-a42c-3f50834b9502-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-8c95226f-80f9-4b96-8ac4-808f5fc67c4d" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-8c95226f-80f9-4b96-8ac4-808f5fc67c4d" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[25028970-dd60-4c44-95ca-b52481dea6d7]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:10 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7.b1c54f31-db7f-4706-9670-db9718a098a9" returned: 0 in 0.720s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b1c54f31-db7f-4706-9670-db9718a098a9" released by "_delete_snapshot" :: held 3.213s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b73e08b2-bf90-405c-9e08-3deaac206fb7" released by "delete_snapshot" :: held 3.237s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:10 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d Apr 29 09:17:10 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:10 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a" returned: 0 in 0.820s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:10 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 1G Apr 29 09:17:10 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Created reservations ['54c30daa-0dbe-4066-9d54-653a34190fde', '3e4d06ff-ff30-49d2-a638-8b8c8933e1c2', '11041f37-cc40-4396-9c04-89377d137fef', '61e88776-9861-4d8c-b1ef-ba9e3c754ce2'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Delete snapshot completed successfully. Apr 29 09:17:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-7a724a8f-755a-4b89-b708-b3185b820d3c tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-b1c54f31-db7f-4706-9670-db9718a098a9-delete_snapshot" released by "delete_snapshot" :: held 3.482s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Flow 'volume_create_manager' (c7958342-6b09-46f7-9030-dc00291b6180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666b4691-9d23-4b61-9228-04825f15ebf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666b4691-9d23-4b61-9228-04825f15ebf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-171773976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddba069-44e8-428a-be98-adc63d4ec534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e518fcbc5454887b13f15ba94ef8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:11Z,use_quota=True,user_id='393a628a71f14f7991ab7d7bdb30e05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9018e632-a756-4c4d-a726-6565df8f701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9018e632-a756-4c4d-a726-6565df8f701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36635079-3c91-4d56-8da9-2cc2608a027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36635079-3c91-4d56-8da9-2cc2608a027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ddba069-44e8-428a-be98-adc63d4ec534', 'volume_name': 'volume-1ddba069-44e8-428a-be98-adc63d4ec534', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d6604c-33c3-4c94-a32d-a55626bcac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d6604c-33c3-4c94-a32d-a55626bcac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d03d31-5df3-421b-82e9-ea0de9a1bfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:11 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Volume 1ddba069-44e8-428a-be98-adc63d4ec534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ddba069-44e8-428a-be98-adc63d4ec534', 'volume_size': 1} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:11 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d" returned: 0 in 0.799s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:11 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d Apr 29 09:17:11 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:11 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 1G" returned: 0 in 0.777s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279c332d-a008-4787-97eb-a9337db6e62a -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:11 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279c332d-a008-4787-97eb-a9337db6e62a -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 Apr 29 09:17:11 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-b73e08b2-bf90-405c-9e08-3deaac206fb7-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-b73e08b2-bf90-405c-9e08-3deaac206fb7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-b73e08b2-bf90-405c-9e08-3deaac206fb7" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b73e08b2-bf90-405c-9e08-3deaac206fb7" acquired by "delete_volume" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcb0fe4-2bfc-4ffb-bd9a-308ae0ced527]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:11 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:11 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 Apr 29 09:17:11 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:12 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8c95226f-80f9-4b96-8ac4-808f5fc67c4d" returned: 0 in 0.626s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-8c95226f-80f9-4b96-8ac4-808f5fc67c4d" released by "delete_volume" :: held 1.492s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created reservations ['7091c6f0-adab-4c5b-af9e-36f3cbb384d4', '045e7d41-3b9a-4799-81c2-c7f61adb85aa', 'bc6b3bc2-d49a-4384-9d89-4b18aed8f486', 'f78ba5b0-a60a-4bbd-9ae1-027980a73f69'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:12 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:12 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:12 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279c332d-a008-4787-97eb-a9337db6e62a -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42" returned: 0 in 0.730s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:12 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 is being set with open permissions: ugo+rw Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:12 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 Apr 29 09:17:12 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:12 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7" returned: 0 in 0.767s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:12 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7 Apr 29 09:17:12 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-e84f77c2-8c7f-421b-bfdb-e163bcc2b451-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-e84f77c2-8c7f-421b-bfdb-e163bcc2b451-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-804ccd2b-8abf-476b-9406-8112dcf92235" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-804ccd2b-8abf-476b-9406-8112dcf92235" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-e84f77c2-8c7f-421b-bfdb-e163bcc2b451" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-e84f77c2-8c7f-421b-bfdb-e163bcc2b451" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Deleting offline snapshot e84f77c2-8c7f-421b-bfdb-e163bcc2b451 of volume 804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] snapshot_file for this snap is: volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:17:12 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f3f75-8f4c-42f4-bb9c-666a4c0c725c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.624s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:12 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Deleted volume successfully. Apr 29 09:17:12 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-39e24808-64a6-4d07-904d-ae78d7573f20 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-8c95226f-80f9-4b96-8ac4-808f5fc67c4d-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:12 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 Apr 29 09:17:12 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:13 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42" returned: 0 in 0.685s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:13 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.info Apr 29 09:17:13 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:13 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b73e08b2-bf90-405c-9e08-3deaac206fb7" returned: 0 in 0.661s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-b73e08b2-bf90-405c-9e08-3deaac206fb7" released by "delete_volume" :: held 1.493s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Created reservations ['f09434e2-e964-4187-903d-50252be12038', '68a7bef9-ae2b-4fc0-ac1a-a0550b0103be', '5e6ca51b-5e09-4b2c-8581-a39a8450e739', 'aa2d7ca0-3c74-4260-be3d-46856c3e19f9'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:13 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:13 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:13 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451" returned: 0 in 0.773s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-804ccd2b-8abf-476b-9406-8112dcf92235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[3592bad2-34ed-44c6-ad57-16db8478c994]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:13 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.info" returned: 0 in 0.610s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:13 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.info is being set with open permissions: ugo+rw Apr 29 09:17:13 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:13 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.info Apr 29 09:17:13 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:13 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 Apr 29 09:17:13 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:14 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.615s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:14 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Deleted volume successfully. Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-4842ad8c-5356-4665-9ed8-11ca92105c8f tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-b73e08b2-bf90-405c-9e08-3deaac206fb7-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:14 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.info" returned: 0 in 0.698s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.151s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-171773976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddba069-44e8-428a-be98-adc63d4ec534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e518fcbc5454887b13f15ba94ef8fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:11Z,use_quota=True,user_id='393a628a71f14f7991ab7d7bdb30e05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Creating volume 1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:14 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:14 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:14 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 1073741824 Apr 29 09:17:14 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235" returned: 0 in 0.787s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:14 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 Apr 29 09:17:14 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-904a56b9-e3f5-4398-86cd-3ba391b74f75 tempest-SnapshotDependencyTests-404261910 None] Create snapshot completed successfully Apr 29 09:17:14 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (c82fb616-1e4a-40cd-afba-cdc73110a11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a4b2cb-a871-4fe8-ba2b-bd82f36ffe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a4b2cb-a871-4fe8-ba2b-bd82f36ffe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1427419314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b009e5a-b305-48e4-88c7-24e4e01eaf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2adf22c05f95484d8ae57ee004e4fadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:14Z,use_quota=True,user_id='d549650f6aae4d30a5ba1432145069b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591856f6-ebc4-45d2-931e-7ef9326d6cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591856f6-ebc4-45d2-931e-7ef9326d6cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ff958b-5063-4ad7-81df-b5ec57fc4e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ff958b-5063-4ad7-81df-b5ec57fc4e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b009e5a-b305-48e4-88c7-24e4e01eaf9d', 'volume_name': 'volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0931ca58-2bce-4439-9da6-d93cc8563cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0931ca58-2bce-4439-9da6-d93cc8563cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1324bde2-37e5-46db-b135-b696efaae626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:14 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Volume 3b009e5a-b305-48e4-88c7-24e4e01eaf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d', 'volume_size': 1} Apr 29 09:17:14 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:15 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451" returned: 0 in 0.691s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:15 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 1073741824" returned: 0 in 0.748s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:15 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451 Apr 29 09:17:15 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:15 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 Apr 29 09:17:15 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:15 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235.e84f77c2-8c7f-421b-bfdb-e163bcc2b451" returned: 0 in 0.612s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Flow 'volume_create_manager' (d727aa05-d5e7-4921-9588-1dcf80f045a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540b954f-3096-47d2-98bb-d5bc1e7c1c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (540b954f-3096-47d2-98bb-d5bc1e7c1c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74094b1-479e-4cbc-8d52-be0287cbf5b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da9e500906e4cd0bca411b7a0a0f802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a73210cd-48ab-4d22-bf86-76ab9321cc42,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:16Z,use_quota=True,user_id='e4d5e0c24e004e31bbbd6808f521a737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c070d65e-22e0-4874-bc23-e259a54672b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c070d65e-22e0-4874-bc23-e259a54672b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e35573-6c60-4241-9bbe-b22d1553925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e35573-6c60-4241-9bbe-b22d1553925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e74094b1-479e-4cbc-8d52-be0287cbf5b0', 'volume_name': 'volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0', 'volume_size': 1, 'snapshot_id': 'a73210cd-48ab-4d22-bf86-76ab9321cc42'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a287ab21-b667-4744-ad8d-d3e1c526b066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a287ab21-b667-4744-ad8d-d3e1c526b066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e88a45-ebb1-4134-9a66-9e993fd634e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:15 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Volume e74094b1-479e-4cbc-8d52-be0287cbf5b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0', 'volume_size': 1, 'snapshot_id': 'a73210cd-48ab-4d22-bf86-76ab9321cc42'} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-e84f77c2-8c7f-421b-bfdb-e163bcc2b451" released by "_delete_snapshot" :: held 3.060s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:15 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534" returned: 0 in 0.721s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-804ccd2b-8abf-476b-9406-8112dcf92235" released by "delete_snapshot" :: held 3.149s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1427419314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b009e5a-b305-48e4-88c7-24e4e01eaf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2adf22c05f95484d8ae57ee004e4fadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:14Z,use_quota=True,user_id='d549650f6aae4d30a5ba1432145069b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Creating volume 3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:15 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:15 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d 1073741824 Apr 29 09:17:15 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d03d31-5df3-421b-82e9-ea0de9a1bfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ddba069-44e8-428a-be98-adc63d4ec534', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10c0358-4896-49a0-9fcb-4f9085e62be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:15 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Volume volume-1ddba069-44e8-428a-be98-adc63d4ec534 (1ddba069-44e8-428a-be98-adc63d4ec534): created successfully Apr 29 09:17:15 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10c0358-4896-49a0-9fcb-4f9085e62be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Flow 'volume_create_manager' (c7958342-6b09-46f7-9030-dc00291b6180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:16 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-0eff0426-f0f2-4955-8be6-adfe6687f29b tempest-CinderUnicodeTest-1966797194 None] Created volume successfully. Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created reservations ['cf225a40-9149-4e5a-bf03-2de59ad92ed3', '60a379e3-ce8f-4783-a7cf-34d790d94e30', 'eb693681-72a6-47f4-80f9-980416a250d6', '6344cbd2-458a-43f2-a805-fca346134e6d'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:16 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Delete snapshot completed successfully. Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-be1fc969-4458-4ccb-9e82-6525d60b7d1c tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-e84f77c2-8c7f-421b-bfdb-e163bcc2b451-delete_snapshot" released by "delete_snapshot" :: held 3.336s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:16 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d 1073741824" returned: 0 in 0.799s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:16 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d Apr 29 09:17:16 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-804ccd2b-8abf-476b-9406-8112dcf92235-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:16 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-804ccd2b-8abf-476b-9406-8112dcf92235-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "cinder-quobyte-804ccd2b-8abf-476b-9406-8112dcf92235" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-804ccd2b-8abf-476b-9406-8112dcf92235" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b77f47-7dbe-408b-9d77-2dc443d74bf0]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:17 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 Apr 29 09:17:17 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:17 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" returned: 0 in 0.578s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.432s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-quobyte-a73210cd-48ab-4d22-bf86-76ab9321cc42-e74094b1-479e-4cbc-8d52-be0287cbf5b0" by "_create_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1324bde2-37e5-46db-b135-b696efaae626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d4b2dd-ce52-4895-9560-9b4a8490ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-a73210cd-48ab-4d22-bf86-76ab9321cc42-e74094b1-479e-4cbc-8d52-be0287cbf5b0" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Creating volume e74094b1-479e-4cbc-8d52-be0287cbf5b0 from snapshot a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-quobyte-e74094b1-479e-4cbc-8d52-be0287cbf5b0" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:17 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Volume volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d (3b009e5a-b305-48e4-88c7-24e4e01eaf9d): created successfully Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d4b2dd-ce52-4895-9560-9b4a8490ed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (c82fb616-1e4a-40cd-afba-cdc73110a11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-e74094b1-479e-4cbc-8d52-be0287cbf5b0" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] snapshot: a73210cd-48ab-4d22-bf86-76ab9321cc42, volume: e74094b1-479e-4cbc-8d52-be0287cbf5b0, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:17:17 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-3bcccdb8-afb9-496f-9ecc-f568ec590ca7 tempest-VolumeDependencyTests-1381849232 None] Created volume successfully. Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eece565-db81-4c9d-867a-273b3f5bad6b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:17 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 Apr 29 09:17:17 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:17 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235" returned: 0 in 0.761s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:17 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:17 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235 Apr 29 09:17:17 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (d568bd74-d77e-4dfd-9370-b91c28a51e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46584c87-e37e-46f4-9379-7037ec06b84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46584c87-e37e-46f4-9379-7037ec06b84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-878181383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106e4da6-5677-4ccb-8507-6f934b325f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2adf22c05f95484d8ae57ee004e4fadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3b009e5a-b305-48e4-88c7-24e4e01eaf9d,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:18Z,use_quota=True,user_id='d549650f6aae4d30a5ba1432145069b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bcf033-13ca-4b67-9d98-b7949ffc2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bcf033-13ca-4b67-9d98-b7949ffc2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff2a2a5-e46c-4e48-ba38-547926920320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff2a2a5-e46c-4e48-ba38-547926920320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '106e4da6-5677-4ccb-8507-6f934b325f43', 'volume_name': 'volume-106e4da6-5677-4ccb-8507-6f934b325f43', 'volume_size': 1, 'source_volid': '3b009e5a-b305-48e4-88c7-24e4e01eaf9d', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18066cd1-b779-4f17-82d8-00992c3fc462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18066cd1-b779-4f17-82d8-00992c3fc462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad07006-cd47-4a7b-8086-ed639b0355cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:18 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Volume 106e4da6-5677-4ccb-8507-6f934b325f43: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-106e4da6-5677-4ccb-8507-6f934b325f43', 'volume_size': 1, 'source_volid': '3b009e5a-b305-48e4-88c7-24e4e01eaf9d', 'source_volstatus': 'available'} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:18 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42" returned: 0 in 0.792s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279c332d-a008-4787-97eb-a9337db6e62a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[77180edc-69a5-48ec-88f2-1f943ae42c42]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:18 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a Apr 29 09:17:18 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:18 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-804ccd2b-8abf-476b-9406-8112dcf92235" returned: 0 in 0.617s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-quobyte-804ccd2b-8abf-476b-9406-8112dcf92235" released by "delete_volume" :: held 1.444s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Created reservations ['c3ece5ed-f58c-4165-9cca-54da49ef0f78', 'bbf3e446-3736-4c53-8738-00ef8dfd700a', 'a8f2d25d-80b6-45d1-87f9-b9b0bfa36364', '94b7f9d2-1f31-44bd-b364-79fa85603222'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:18 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:18 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:18 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a" returned: 0 in 0.694s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:17:18 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:19 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 Apr 29 09:17:19 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:19 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:19 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.620s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:19 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:19 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Deleted volume successfully. Apr 29 09:17:19 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-dd8d3ab9-19be-40c6-acfb-b8d17fea7696 tempest-CreateVolumesFromSnapshotTest-1708051032 None] Lock "cinder-804ccd2b-8abf-476b-9406-8112dcf92235-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:24 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0" returned: 0 in 5.359s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (3f0ff714-adf0-48a5-a876-d4e99bfd87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c14fcbe-bbd0-43fb-b010-3a7423673008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca17f9-1119-41ec-8f3c-2e74638aeb4a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c14fcbe-bbd0-43fb-b010-3a7423673008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730759642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92471916-7e95-487d-abf9-cf17d1166baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:24Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be002c6-3d96-4013-9058-12de39cdb069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be002c6-3d96-4013-9058-12de39cdb069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b28fcb-ff9c-484a-8341-8eba52c1fb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b28fcb-ff9c-484a-8341-8eba52c1fb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92471916-7e95-487d-abf9-cf17d1166baa', 'volume_name': 'volume-92471916-7e95-487d-abf9-cf17d1166baa', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf26a9df-56a8-4f4e-860a-682b5bef8f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf26a9df-56a8-4f4e-860a-682b5bef8f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdfd21a-2db9-48e0-8af0-4e9600e90bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:24 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume 92471916-7e95-487d-abf9-cf17d1166baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92471916-7e95-487d-abf9-cf17d1166baa', 'volume_size': 1} Apr 29 09:17:24 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:24 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a Apr 29 09:17:24 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:25 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a" returned: 0 in 0.849s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:17:25 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Converted 1024.00 MB image at 191.05 MB/s Apr 29 09:17:25 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 is being set with open permissions: ugo+rw Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:25 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 Apr 29 09:17:25 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:25 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0" returned: 0 in 0.562s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-e74094b1-479e-4cbc-8d52-be0287cbf5b0" released by "_copy_volume_from_snapshot" :: held 8.380s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-a73210cd-48ab-4d22-bf86-76ab9321cc42-e74094b1-479e-4cbc-8d52-be0287cbf5b0" released by "_create_volume_from_snapshot" :: held 8.434s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.465s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.062s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Creating offline snapshot 31e1e586-0f1c-4870-9667-eec7f88c0869 of volume 1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912626f-a681-4b0e-9c55-3410082588ab]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e88a45-ebb1-4134-9a66-9e993fd634e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0', 'volume_size': 1, 'snapshot_id': 'a73210cd-48ab-4d22-bf86-76ab9321cc42'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7081be-4ba7-46c3-aa6b-c705637ad648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:25 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Volume volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 (e74094b1-479e-4cbc-8d52-be0287cbf5b0): created successfully Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7081be-4ba7-46c3-aa6b-c705637ad648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:25 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Flow 'volume_create_manager' (d727aa05-d5e7-4921-9588-1dcf80f045a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:25 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-59e342f8-341d-456f-8c99-a758d9a963de tempest-SnapshotDependencyTests-404261910 None] Created volume successfully. Apr 29 09:17:25 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 Apr 29 09:17:25 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:26 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534" returned: 0 in 0.741s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:26 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 1G Apr 29 09:17:26 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-a73210cd-48ab-4d22-bf86-76ab9321cc42-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-a73210cd-48ab-4d22-bf86-76ab9321cc42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-quobyte-279c332d-a008-4787-97eb-a9337db6e62a" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-279c332d-a008-4787-97eb-a9337db6e62a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-quobyte-a73210cd-48ab-4d22-bf86-76ab9321cc42" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-a73210cd-48ab-4d22-bf86-76ab9321cc42" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Deleting offline snapshot a73210cd-48ab-4d22-bf86-76ab9321cc42 of volume 279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] snapshot_file for this snap is: volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf06615f-eb67-48ff-ac0e-134f2467d7cf]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:26 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:27 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 Apr 29 09:17:27 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:27 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 1G" returned: 0 in 0.808s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ddba069-44e8-428a-be98-adc63d4ec534 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:27 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ddba069-44e8-428a-be98-adc63d4ec534 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 Apr 29 09:17:27 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:27 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42" returned: 0 in 0.701s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:27 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279c332d-a008-4787-97eb-a9337db6e62a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:17:27 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb7878c-6e1c-4e10-9dea-118f4e8074e7]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:27 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:27 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a Apr 29 09:17:27 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:28 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ddba069-44e8-428a-be98-adc63d4ec534 -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869" returned: 0 in 0.690s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:28 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 is being set with open permissions: ugo+rw Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:28 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 Apr 29 09:17:28 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:28 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a" returned: 0 in 0.766s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:28 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 Apr 29 09:17:28 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:28 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869" returned: 0 in 0.609s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=134,cinder:UPDATE=153,cinder:INSERT=31,cinder:DELETE=19 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:UPDATE=178,cinder:SELECT=114,cinder:DELETE=14,cinder:INSERT=44 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:17:28 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:28 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.info Apr 29 09:17:28 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:29 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42" returned: 0 in 0.701s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:29 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42 Apr 29 09:17:29 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:29 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.info" returned: 0 in 0.623s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:29 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.info is being set with open permissions: ugo+rw Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:29 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.info Apr 29 09:17:29 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:29 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a.a73210cd-48ab-4d22-bf86-76ab9321cc42" returned: 0 in 0.558s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-a73210cd-48ab-4d22-bf86-76ab9321cc42" released by "_delete_snapshot" :: held 2.844s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-279c332d-a008-4787-97eb-a9337db6e62a" released by "delete_snapshot" :: held 2.870s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Created reservations ['ae7dc27a-c035-4d5f-9da7-803224d83527', 'cccb0fab-7f88-41fa-9338-2e3152b871a7', '8078716c-16a1-4f44-8a9f-999a7269c3d7', '0036d432-3e91-44ce-aa92-9ef445648592'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:29 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Delete snapshot completed successfully. Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-701c5699-738d-4b38-a185-adb94643cc84 tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-a73210cd-48ab-4d22-bf86-76ab9321cc42-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:29 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:29 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.info" returned: 0 in 0.623s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.193s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.753s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:30 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Cloning volume 3b009e5a-b305-48e4-88c7-24e4e01eaf9d to volume 106e4da6-5677-4ccb-8507-6f934b325f43 Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-279c332d-a008-4787-97eb-a9337db6e62a-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-279c332d-a008-4787-97eb-a9337db6e62a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Creating offline snapshot 4e4fa47a-df31-46bf-bdb1-a920eebf5269 of volume 3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 09:17:30 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b0592885-b18d-4930-906a-1e11eb6b98af tempest-CinderUnicodeTest-1966797194 None] Create snapshot completed successfully Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8e7e38-654f-42a1-94c9-351aaf5b7a26]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-quobyte-279c332d-a008-4787-97eb-a9337db6e62a" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-279c332d-a008-4787-97eb-a9337db6e62a" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[2504cda8-10d5-4447-adf8-865b796c920c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:30 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d Apr 29 09:17:30 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:30 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a Apr 29 09:17:30 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "cinder-31e1e586-0f1c-4870-9667-eec7f88c0869-delete_snapshot" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-31e1e586-0f1c-4870-9667-eec7f88c0869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "cinder-quobyte-1ddba069-44e8-428a-be98-adc63d4ec534" by "delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-1ddba069-44e8-428a-be98-adc63d4ec534" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "cinder-quobyte-31e1e586-0f1c-4870-9667-eec7f88c0869" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-31e1e586-0f1c-4870-9667-eec7f88c0869" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Deleting offline snapshot 31e1e586-0f1c-4870-9667-eec7f88c0869 of volume 1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] snapshot_file for this snap is: volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f3111-f27b-48e5-a188-98f545acafea]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:30 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 Apr 29 09:17:30 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:30 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" returned: 0 in 0.730s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:30 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 1G {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:30 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 1G Apr 29 09:17:30 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:30 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a" returned: 0 in 0.772s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:31 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a Apr 29 09:17:31 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:31 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869" returned: 0 in 0.776s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ddba069-44e8-428a-be98-adc63d4ec534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[babe45fe-b1a7-4ab0-8eab-d913acffd63a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:31 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 Apr 29 09:17:31 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:31 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 1G" returned: 0 in 0.817s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:31 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-279c332d-a008-4787-97eb-a9337db6e62a" returned: 0 in 0.677s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:31 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 Apr 29 09:17:31 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-279c332d-a008-4787-97eb-a9337db6e62a" released by "delete_volume" :: held 1.539s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Created reservations ['5cd57b66-aa98-447d-8b77-a7d4aeb23dba', 'ad4907d4-c1c6-4eb1-8b41-423234e773f1', 'bec4dd95-abd6-41d5-8593-9e403ef4612d', '0e64143a-e297-4431-973f-39adc4ecfa83'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:31 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:31 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:31 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:32 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534" returned: 0 in 0.787s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:32 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 Apr 29 09:17:32 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-e74094b1-479e-4cbc-8d52-be0287cbf5b0-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-e74094b1-479e-4cbc-8d52-be0287cbf5b0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "cinder-quobyte-e74094b1-479e-4cbc-8d52-be0287cbf5b0" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-e74094b1-479e-4cbc-8d52-be0287cbf5b0" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37782d8-7fa7-4151-aa7a-6067fd6c0d01]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:32 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d -F qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269" returned: 0 in 0.828s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:32 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 is being set with open permissions: ugo+rw Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:32 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 Apr 29 09:17:32 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:32 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.693s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:32 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 Apr 29 09:17:32 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:32 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Deleted volume successfully. Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c876bf01-c16f-4117-b18a-8c0ae0e8151d tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-279c332d-a008-4787-97eb-a9337db6e62a-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:32 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869" returned: 0 in 0.782s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:32 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:33 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869 Apr 29 09:17:33 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:33 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269" returned: 0 in 0.622s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:33 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.info Apr 29 09:17:33 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:33 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0" returned: 0 in 0.801s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:33 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0 Apr 29 09:17:33 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:33 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534.31e1e586-0f1c-4870-9667-eec7f88c0869" returned: 0 in 0.649s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-31e1e586-0f1c-4870-9667-eec7f88c0869" released by "_delete_snapshot" :: held 3.129s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-1ddba069-44e8-428a-be98-adc63d4ec534" released by "delete_snapshot" :: held 3.156s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Created reservations ['75cd4972-f03f-46cc-9f73-8bc0fa73513c', 'fc60ab61-851b-4b4d-9dc2-983d3a1df542', 'e76f2176-5a58-4479-972f-72d3fb9aab9a', '5c638551-ac31-4307-8637-f5a69b230dbd'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:33 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.info" returned: 0 in 0.641s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:33 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.info is being set with open permissions: ugo+rw Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.info {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:33 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.info Apr 29 09:17:33 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:33 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Delete snapshot completed successfully. Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-846a14ef-93eb-4668-a848-63b2f0754b39 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-31e1e586-0f1c-4870-9667-eec7f88c0869-delete_snapshot" released by "delete_snapshot" :: held 3.363s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:33 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-e74094b1-479e-4cbc-8d52-be0287cbf5b0" returned: 0 in 0.663s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-quobyte-e74094b1-479e-4cbc-8d52-be0287cbf5b0" released by "delete_volume" :: held 1.505s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Created reservations ['ca7091d8-0b11-4634-8009-c548d8996745', '0e847d96-4009-4929-8a21-70f6580bc71d', '160a528f-ff14-46ac-a627-9f848c5c4bd5', 'f981244e-e7cf-46bd-8d3b-6661a60737aa'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:33 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:34 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:34 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:34 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.info" returned: 0 in 0.609s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-106e4da6-5677-4ccb-8507-6f934b325f43" by "_copy_volume_from_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-106e4da6-5677-4ccb-8507-6f934b325f43" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] snapshot: 4e4fa47a-df31-46bf-bdb1-a920eebf5269, volume: 106e4da6-5677-4ccb-8507-6f934b325f43, {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f383f8-457a-4ec2-83e3-e0f2845183dd]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:34 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 Apr 29 09:17:34 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:34 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.649s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:34 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Deleted volume successfully. Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-67d89570-5a47-48ce-a69e-8065444931de tempest-SnapshotDependencyTests-404261910 None] Lock "cinder-e74094b1-479e-4cbc-8d52-be0287cbf5b0-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "cinder-1ddba069-44e8-428a-be98-adc63d4ec534-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-1ddba069-44e8-428a-be98-adc63d4ec534-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "cinder-quobyte-1ddba069-44e8-428a-be98-adc63d4ec534" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-1ddba069-44e8-428a-be98-adc63d4ec534" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7e2c38-30fd-4b78-885e-81bae7c8aa93]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:34 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:35 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 Apr 29 09:17:35 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:35 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269" returned: 0 in 0.786s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] will copy from snapshot at /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Creating direct copy from snapshot {{(pid=84004) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dcece1-5887-4a63-b278-cdedfed0cbba]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:35 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d Apr 29 09:17:35 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:35 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534" returned: 0 in 0.784s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:35 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:35 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534 Apr 29 09:17:35 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:36 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" returned: 0 in 0.748s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG cinder.utils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Path /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 not found in is_blk_device check {{(pid=84004) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:36 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 Apr 29 09:17:36 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:36 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1ddba069-44e8-428a-be98-adc63d4ec534" returned: 0 in 0.614s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-1ddba069-44e8-428a-be98-adc63d4ec534" released by "delete_volume" :: held 1.485s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Created reservations ['7102f08e-0d27-4098-a070-2681b9fe77d6', '5822d56a-3633-4f0c-8db5-ec60688fe313', 'c4e3578e-c23b-4c23-9546-abd6bdde4471', 'cee3773e-59b3-4e6f-96b2-c7f8f64ea631'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:36 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:36 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:36 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "cinder-b0f88179-ef01-4266-87f1-87b664be8350-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-b0f88179-ef01-4266-87f1-87b664be8350-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "cinder-quobyte-b0f88179-ef01-4266-87f1-87b664be8350" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:37 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.944s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:37 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Deleted volume successfully. Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-b0f88179-ef01-4266-87f1-87b664be8350" acquired by "delete_volume" :: waited 0.038s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-8581a5ee-a606-4938-a287-ba3acf36ce03 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-1ddba069-44e8-428a-be98-adc63d4ec534-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[771fc938-d6b8-4d49-b000-30558818c902]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:37 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:37 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 Apr 29 09:17:37 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:38 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350" returned: 0 in 1.468s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:38 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:39 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350 Apr 29 09:17:39 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:40 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:40 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b0f88179-ef01-4266-87f1-87b664be8350" returned: 0 in 1.767s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:40 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-quobyte-b0f88179-ef01-4266-87f1-87b664be8350" released by "delete_volume" :: held 3.354s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:40 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Created reservations ['411d2df1-28dc-4fa9-930e-9343fc61b400', '4c49e3f5-989d-45e7-b320-8d56802d9aa0', '27d5746f-17d8-45b3-be24-e7393813d4ab', '273ff74f-b31c-4b3d-9437-9103f6e7b460'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:41 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:41 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:41 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:41 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:41 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43" returned: 0 in 5.949s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:42 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0378a1ed-cf18-4259-81b9-031b4b53b5b3]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:42 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d Apr 29 09:17:42 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:42 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:42 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 1.107s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:42 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:42 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Deleted volume successfully. Apr 29 09:17:42 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-9fd9d310-19ff-4b83-9138-869aeeadcb25 tempest-CinderUnicodeTest-1966797194 None] Lock "cinder-b0f88179-ef01-4266-87f1-87b664be8350-delete_volume" released by "delete_volume" :: held 5.103s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:43 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" returned: 0 in 0.998s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG cinder.image.image_utils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Image conversion details: src /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 {{(pid=84004) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 09:17:43 devstack cinder-volume[84004]: INFO cinder.image.image_utils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Converted 1024.00 MB image at 172.08 MB/s Apr 29 09:17:43 devstack cinder-volume[84004]: WARNING cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 is being set with open permissions: ugo+rw Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:43 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 Apr 29 09:17:43 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:43 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43" returned: 0 in 0.721s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-106e4da6-5677-4ccb-8507-6f934b325f43" released by "_copy_volume_from_snapshot" :: held 9.314s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-4e4fa47a-df31-46bf-bdb1-a920eebf5269" by "_delete_snapshot" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-4e4fa47a-df31-46bf-bdb1-a920eebf5269" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Deleting offline snapshot 4e4fa47a-df31-46bf-bdb1-a920eebf5269 of volume 3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] snapshot_file for this snap is: volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 {{(pid=84004) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629ab38-edd5-4367-8686-022e1274b652]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:43 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:43 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 Apr 29 09:17:43 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:44 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269" returned: 0 in 0.713s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:44 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84004) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 09:17:44 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f3b59-7974-4274-b276-06d6d0d98032]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:44 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:44 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d Apr 29 09:17:44 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:45 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" returned: 0 in 0.771s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:45 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:45 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 Apr 29 09:17:45 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:46 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269" returned: 0 in 0.683s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:46 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269 Apr 29 09:17:46 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:46 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d.4e4fa47a-df31-46bf-bdb1-a920eebf5269" returned: 0 in 0.726s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-4e4fa47a-df31-46bf-bdb1-a920eebf5269" released by "_delete_snapshot" :: held 3.037s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.845s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.422s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730759642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92471916-7e95-487d-abf9-cf17d1166baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:24Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Creating volume 92471916-7e95-487d-abf9-cf17d1166baa {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:46 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad07006-cd47-4a7b-8086-ed639b0355cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106e4da6-5677-4ccb-8507-6f934b325f43', 'volume_size': 1, 'source_volid': '3b009e5a-b305-48e4-88c7-24e4e01eaf9d', 'source_volstatus': 'available'}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:46 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa 1073741824 Apr 29 09:17:46 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5b0bf7-31e8-4c52-933b-3fea39f49590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:46 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Volume volume-106e4da6-5677-4ccb-8507-6f934b325f43 (106e4da6-5677-4ccb-8507-6f934b325f43): created successfully Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5b0bf7-31e8-4c52-933b-3fea39f49590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:46 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Flow 'volume_create_manager' (d568bd74-d77e-4dfd-9370-b91c28a51e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:46 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-458ead23-9dab-48ee-a890-5f7afea1d926 tempest-VolumeDependencyTests-1381849232 None] Created volume successfully. Apr 29 09:17:47 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa 1073741824" returned: 0 in 0.780s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:47 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa Apr 29 09:17:47 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-3b009e5a-b305-48e4-88c7-24e4e01eaf9d-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-3b009e5a-b305-48e4-88c7-24e4e01eaf9d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1974611-f8ec-40ad-b844-33833a732ec5]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:47 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:48 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d Apr 29 09:17:48 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:48 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa" returned: 0 in 0.592s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdfd21a-2db9-48e0-8af0-4e9600e90bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92471916-7e95-487d-abf9-cf17d1166baa', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c69fed1-c4f6-4f44-b8d5-06d95b27ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:48 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume volume-92471916-7e95-487d-abf9-cf17d1166baa (92471916-7e95-487d-abf9-cf17d1166baa): created successfully Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c69fed1-c4f6-4f44-b8d5-06d95b27ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (3f0ff714-adf0-48a5-a876-d4e99bfd87d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:48 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-f5b7dbca-afd3-4538-bb80-64595108f77c tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created volume successfully. Apr 29 09:17:48 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" returned: 0 in 0.696s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:48 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:48 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d Apr 29 09:17:48 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:49 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" returned: 0 in 0.559s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-3b009e5a-b305-48e4-88c7-24e4e01eaf9d" released by "delete_volume" :: held 1.307s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Created reservations ['e3a26f6a-6850-4854-8c6a-cdb665622b18', 'eca1db84-bd65-46b7-a553-b25cdd0a7642', '74f7b1bb-fc63-4151-87f8-b1cf01f81d78', 'd992602e-d3b1-45ee-aa60-b9711a294b60'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:49 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:49 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (ccbb257c-5a32-4057-b9ba-2aabfefea662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0f1739-bdb4-43c3-9f94-c9a5673216e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0f1739-bdb4-43c3-9f94-c9a5673216e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-896817145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5062d1-2a49-4359-8776-4b667c73513e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:50Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a40ee-4e0b-4b17-ae7f-c82ff5d40d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a40ee-4e0b-4b17-ae7f-c82ff5d40d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cece767f-01bd-40dc-85e7-fe7cf8bf0d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cece767f-01bd-40dc-85e7-fe7cf8bf0d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5062d1-2a49-4359-8776-4b667c73513e', 'volume_name': 'volume-5d5062d1-2a49-4359-8776-4b667c73513e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb9fd6-9548-4774-8701-a78e29986080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb9fd6-9548-4774-8701-a78e29986080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f91081-ca55-4711-9a09-cb96f6fd9cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:49 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume 5d5062d1-2a49-4359-8776-4b667c73513e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5062d1-2a49-4359-8776-4b667c73513e', 'volume_size': 1} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-896817145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5062d1-2a49-4359-8776-4b667c73513e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:50Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Creating volume 5d5062d1-2a49-4359-8776-4b667c73513e {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:49 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:49 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.580s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:49 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Deleted volume successfully. Apr 29 09:17:49 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e 1073741824 Apr 29 09:17:49 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:49 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c9df4135-f19f-40ef-816b-4956790dc8fb tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-3b009e5a-b305-48e4-88c7-24e4e01eaf9d-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-106e4da6-5677-4ccb-8507-6f934b325f43-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-106e4da6-5677-4ccb-8507-6f934b325f43-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (27c3a027-e70a-4d7c-a3de-f336bec8c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404cb267-a710-436b-bbd8-08b98778d608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404cb267-a710-436b-bbd8-08b98778d608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826287097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c2c60b-9489-488f-97ab-4d4b9c52cc41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:50Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8188aca0-41b6-44a1-8cbc-4d27845417e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8188aca0-41b6-44a1-8cbc-4d27845417e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb003acb-6057-4c6c-8159-167b4a7c5a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb003acb-6057-4c6c-8159-167b4a7c5a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c2c60b-9489-488f-97ab-4d4b9c52cc41', 'volume_name': 'volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bef7d5-4f30-4e1d-be40-e8d1c0e19288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bef7d5-4f30-4e1d-be40-e8d1c0e19288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a015a4cd-333c-4f12-b3e6-d7a2fa7b7b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume 74c2c60b-9489-488f-97ab-4d4b9c52cc41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41', 'volume_size': 1} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-106e4da6-5677-4ccb-8507-6f934b325f43" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-106e4da6-5677-4ccb-8507-6f934b325f43" acquired by "delete_volume" :: waited 0.023s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[a615f600-4a3b-4b34-96b0-2b153b1cab27]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:50 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 Apr 29 09:17:50 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (61f89c87-969b-4a51-a5bf-ad440cfd6cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c69ed6-b4de-419c-b424-1972c027e123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c69ed6-b4de-419c-b424-1972c027e123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582659618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1420ae24-d09f-40e5-9a24-3908d37a7ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:50Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cf5912-c223-43a4-b7b5-2848c801fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cf5912-c223-43a4-b7b5-2848c801fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7ca6e1-bd31-466d-8a85-ff41f2bec1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7ca6e1-bd31-466d-8a85-ff41f2bec1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1420ae24-d09f-40e5-9a24-3908d37a7ef4', 'volume_name': 'volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2099076-b5be-4cd4-bf4c-2fe82eb585a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2099076-b5be-4cd4-bf4c-2fe82eb585a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42681d66-7835-4e6e-a62f-555358fb7339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume 1420ae24-d09f-40e5-9a24-3908d37a7ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4', 'volume_size': 1} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (f625b539-5321-4b58-903f-8ccff51eac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce63bdb-4106-4701-9e58-4c5dbd72968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce63bdb-4106-4701-9e58-4c5dbd72968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502479630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5019a7f-6860-4ef5-a635-3aea3b22d6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:51Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0ae7b1-6f3a-4d45-8d22-cd1bd7f2e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0ae7b1-6f3a-4d45-8d22-cd1bd7f2e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d19ff57-46fd-4fc3-9526-d0af68fdf404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d19ff57-46fd-4fc3-9526-d0af68fdf404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5019a7f-6860-4ef5-a635-3aea3b22d6e2', 'volume_name': 'volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca362b0-6662-44ae-b88c-e4d12ea43e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca362b0-6662-44ae-b88c-e4d12ea43e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9408361a-ecfd-4019-aa54-cc757f494cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:50 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume f5019a7f-6860-4ef5-a635-3aea3b22d6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2', 'volume_size': 1} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e 1073741824" returned: 0 in 1.019s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:50 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:50 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e Apr 29 09:17:50 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:51 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43" returned: 0 in 0.870s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.flows.manager.create_volume [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84004) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 09:17:51 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43 Apr 29 09:17:51 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (41115ee7-0731-485a-8c1c-0d98204aed2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e2971d-2066-4e7a-8c47-258a0d76b7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e2971d-2066-4e7a-8c47-258a0d76b7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1721881498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2963070-277a-43bf-8d88-59837d004aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:51Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4459d0a6-3510-409a-96bf-4358db66c5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4459d0a6-3510-409a-96bf-4358db66c5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bd442a-7214-4f57-bd76-83804af6baba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bd442a-7214-4f57-bd76-83804af6baba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2963070-277a-43bf-8d88-59837d004aae', 'volume_name': 'volume-b2963070-277a-43bf-8d88-59837d004aae', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a41e3-b6f8-44d3-9832-bbfff26bebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a41e3-b6f8-44d3-9832-bbfff26bebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25680c8d-7168-43d6-b68d-ba1faea2670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:51 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume b2963070-277a-43bf-8d88-59837d004aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2963070-277a-43bf-8d88-59837d004aae', 'volume_size': 1} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:51 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e" returned: 0 in 0.684s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826287097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c2c60b-9489-488f-97ab-4d4b9c52cc41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:50Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Creating volume 74c2c60b-9489-488f-97ab-4d4b9c52cc41 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:51 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f91081-ca55-4711-9a09-cb96f6fd9cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5062d1-2a49-4359-8776-4b667c73513e', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c19023-0007-4f1a-aaa9-4a42cc08ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:51 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 1073741824 Apr 29 09:17:51 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:51 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume volume-5d5062d1-2a49-4359-8776-4b667c73513e (5d5062d1-2a49-4359-8776-4b667c73513e): created successfully Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c19023-0007-4f1a-aaa9-4a42cc08ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (ccbb257c-5a32-4057-b9ba-2aabfefea662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:51 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-e3e31a3e-6edd-4da6-b2e9-98c237f8362f tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created volume successfully. Apr 29 09:17:51 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-106e4da6-5677-4ccb-8507-6f934b325f43" returned: 0 in 0.599s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-106e4da6-5677-4ccb-8507-6f934b325f43" released by "delete_volume" :: held 1.524s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Created reservations ['32f25666-fad2-43fd-a74c-c45de274e708', 'd6a26601-3a9e-4e6f-8044-34adffa45c8f', '12910a7a-4092-4b5b-a673-49241872f03f', '91a0213b-9533-4d3a-b218-66bf2bc61790'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:51 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:51 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:51 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-8ce8e024-21ef-4c71-a973-953bc182a83f-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-8ce8e024-21ef-4c71-a973-953bc182a83f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:52 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:52 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 1073741824" returned: 0 in 0.854s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.603s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:52 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Deleted volume successfully. Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "cinder-quobyte-8ce8e024-21ef-4c71-a973-953bc182a83f" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-8ce8e024-21ef-4c71-a973-953bc182a83f" acquired by "delete_volume" :: waited 0.021s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-21a76f11-8774-4cce-be1d-a0345c22b810 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-106e4da6-5677-4ccb-8507-6f934b325f43-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[116b3bd5-4559-46ac-aae9-ab43f7f28c0b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:52 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:52 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 Apr 29 09:17:52 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:52 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f Apr 29 09:17:52 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:53 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41" returned: 0 in 0.604s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.607s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582659618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1420ae24-d09f-40e5-9a24-3908d37a7ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:50Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Creating volume 1420ae24-d09f-40e5-9a24-3908d37a7ef4 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:53 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a015a4cd-333c-4f12-b3e6-d7a2fa7b7b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:53 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 1073741824 Apr 29 09:17:53 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c84010f-68db-42db-b9e8-0971a27d5ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:53 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 (74c2c60b-9489-488f-97ab-4d4b9c52cc41): created successfully Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c84010f-68db-42db-b9e8-0971a27d5ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (27c3a027-e70a-4d7c-a3de-f336bec8c774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:53 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2194cb71-7018-4116-8fa8-ef93dedae072 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created volume successfully. Apr 29 09:17:53 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f" returned: 0 in 0.717s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:53 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f Apr 29 09:17:53 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:53 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-8ce8e024-21ef-4c71-a973-953bc182a83f" returned: 0 in 0.624s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:53 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-quobyte-8ce8e024-21ef-4c71-a973-953bc182a83f" released by "delete_volume" :: held 1.394s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:53 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 1073741824" returned: 0 in 0.764s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Created reservations ['035ba40f-a2d1-48c6-99d6-c95ee5875d5b', 'dea2961c-cd66-4b23-b11f-af8b811714f8', 'c0970fce-256c-4fb8-9d4c-5f2c51f29ecb', '870e402c-45f6-4880-9b9f-323a7d726a72'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:54 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 Apr 29 09:17:54 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:54 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:54 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:54 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4" returned: 0 in 0.614s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.742s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502479630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5019a7f-6860-4ef5-a635-3aea3b22d6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:51Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Creating volume f5019a7f-6860-4ef5-a635-3aea3b22d6e2 {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:54 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:54 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 1073741824 Apr 29 09:17:54 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42681d66-7835-4e6e-a62f-555358fb7339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:54 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b90e13-d1c7-4564-aa3c-602fd2d6bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.640s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:54 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Deleted volume successfully. Apr 29 09:17:54 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 (1420ae24-d09f-40e5-9a24-3908d37a7ef4): created successfully Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b90e13-d1c7-4564-aa3c-602fd2d6bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (61f89c87-969b-4a51-a5bf-ad440cfd6cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:54 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-eecf5e81-c1ac-408f-9fd0-736f618294b4 tempest-VolumeDependencyTests-1381849232 None] Lock "cinder-8ce8e024-21ef-4c71-a973-953bc182a83f-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:54 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-914f9073-1a55-4196-acef-4d5ca8bd4005 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created volume successfully. Apr 29 09:17:55 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 1073741824" returned: 0 in 0.837s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:55 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:55 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 Apr 29 09:17:55 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:56 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2" returned: 0 in 0.636s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.899s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T07:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1721881498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2963070-277a-43bf-8d88-59837d004aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61fa62b1606c45efaa842eba65ce1fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:51Z,use_quota=True,user_id='1931d9b57c284638b0ae5bc548f3477c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9af8dfa-bb47-49c8-a952-04369041450e),volume_type_id=d9af8dfa-bb47-49c8-a952-04369041450e)}" {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.remotefs [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Creating volume b2963070-277a-43bf-8d88-59837d004aae {{(pid=84004) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Selected osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce as target Quobyte volume. {{(pid=84004) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 09:17:56 devstack cinder-volume[84004]: INFO cinder.volume.drivers.remotefs [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] casted to osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae 1073741824 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9408361a-ecfd-4019-aa54-cc757f494cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeabfa52-41a9-4f0d-802d-b4eaa0759f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:56 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae 1073741824 Apr 29 09:17:56 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:56 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 (f5019a7f-6860-4ef5-a635-3aea3b22d6e2): created successfully Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeabfa52-41a9-4f0d-802d-b4eaa0759f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (f625b539-5321-4b58-903f-8ccff51eac7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:56 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-2968473a-6805-4c1f-ad23-bcb89211f9d5 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created volume successfully. Apr 29 09:17:56 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:56 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae 1073741824" returned: 0 in 0.766s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:57 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae Apr 29 09:17:57 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:57 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae" returned: 0 in 0.562s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'} {{(pid=84004) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25680c8d-7168-43d6-b68d-ba1faea2670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2963070-277a-43bf-8d88-59837d004aae', 'volume_size': 1}' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca388823-8877-4e79-b8e4-45c7b8d92642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 09:17:57 devstack cinder-volume[84004]: INFO cinder.volume.flows.manager.create_volume [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Volume volume-b2963070-277a-43bf-8d88-59837d004aae (b2963070-277a-43bf-8d88-59837d004aae): created successfully Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca388823-8877-4e79-b8e4-45c7b8d92642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84004) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Flow 'volume_create_manager' (41115ee7-0731-485a-8c1c-0d98204aed2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84004) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 09:17:57 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-799d9163-403a-4d05-ace9-3697645c02fb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created volume successfully. Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-b2963070-277a-43bf-8d88-59837d004aae-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-b2963070-277a-43bf-8d88-59837d004aae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-quobyte-b2963070-277a-43bf-8d88-59837d004aae" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-b2963070-277a-43bf-8d88-59837d004aae" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7a721b-9c68-4aff-834d-3a665ce0f7b2]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:17:57 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:57 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae Apr 29 09:17:57 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:58 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae" returned: 0 in 0.671s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:58 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:58 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae Apr 29 09:17:58 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:59 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-b2963070-277a-43bf-8d88-59837d004aae" returned: 0 in 0.585s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-b2963070-277a-43bf-8d88-59837d004aae" released by "delete_volume" :: held 1.294s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created reservations ['e38cc726-68b0-4bac-b998-96c7b9ee0320', '4a78e571-9051-4e32-8efc-b1a0d53c1977', '6dfbb6d1-b46a-40e8-9c86-696b7959ebab', '492f724f-ec0c-424c-a865-fe32bdc0b359'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:17:59 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:17:59 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:17:59 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.587s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:17:59 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Deleted volume successfully. Apr 29 09:17:59 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b539830e-531d-48fa-ae5d-5215133bfd31 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-b2963070-277a-43bf-8d88-59837d004aae-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-f5019a7f-6860-4ef5-a635-3aea3b22d6e2-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-f5019a7f-6860-4ef5-a635-3aea3b22d6e2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-quobyte-f5019a7f-6860-4ef5-a635-3aea3b22d6e2" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-f5019a7f-6860-4ef5-a635-3aea3b22d6e2" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fabe7b-7ac4-4cbd-8942-d98ccc7a0655]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:00 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 Apr 29 09:18:00 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:00 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2" returned: 0 in 0.669s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:00 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:00 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2 Apr 29 09:18:00 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:01 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-f5019a7f-6860-4ef5-a635-3aea3b22d6e2" returned: 0 in 0.571s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-f5019a7f-6860-4ef5-a635-3aea3b22d6e2" released by "delete_volume" :: held 1.277s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created reservations ['dd049508-68f1-4646-9e09-20730d0620b8', '9b8bef9c-9cd0-4b61-8ed5-ae0b89b7c094', 'fc0aa900-8581-45e7-85f5-b75248ab72a8', '78b39af1-25b2-4f8a-8fd1-d5f13947b6b4'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:18:01 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:01 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:18:01 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:02 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.557s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:18:02 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Deleted volume successfully. Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-c45a5a3c-0250-4245-95bb-35e143719caf tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-f5019a7f-6860-4ef5-a635-3aea3b22d6e2-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-1420ae24-d09f-40e5-9a24-3908d37a7ef4-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-1420ae24-d09f-40e5-9a24-3908d37a7ef4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-quobyte-1420ae24-d09f-40e5-9a24-3908d37a7ef4" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-1420ae24-d09f-40e5-9a24-3908d37a7ef4" acquired by "delete_volume" :: waited 0.016s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafc0bf7-d1e0-4d9e-bdaa-45b793b5b35b]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:02 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 Apr 29 09:18:02 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo_service.periodic_task [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:18:02 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:02 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:18:02 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:03 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4" returned: 0 in 0.706s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:03 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4 Apr 29 09:18:03 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:03 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.593s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ca6c5450-c5bf-4063-bda9-009d4c03c253 None None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:18:03 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-1420ae24-d09f-40e5-9a24-3908d37a7ef4" returned: 0 in 0.604s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-1420ae24-d09f-40e5-9a24-3908d37a7ef4" released by "delete_volume" :: held 1.348s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created reservations ['dc9e59c3-3611-4921-bace-adb64d440cf5', '87c0049a-0ecd-46ec-8bf8-a8ff329bda3d', '36ee1ce6-7676-4419-a94b-1d0ca4fdb368', '781e25c8-8070-4544-b841-bfd785b3b9dc'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:18:03 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:03 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:18:03 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:04 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.564s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:18:04 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Deleted volume successfully. Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-08d2c578-f93f-4fd4-bf33-70a6f05187eb tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-1420ae24-d09f-40e5-9a24-3908d37a7ef4-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-74c2c60b-9489-488f-97ab-4d4b9c52cc41-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-74c2c60b-9489-488f-97ab-4d4b9c52cc41-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-quobyte-74c2c60b-9489-488f-97ab-4d4b9c52cc41" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-74c2c60b-9489-488f-97ab-4d4b9c52cc41" acquired by "delete_volume" :: waited 0.013s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b4716d-1a87-4cf2-a133-123297356bcb]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:18:04 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:04 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 Apr 29 09:18:04 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:05 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41" returned: 0 in 0.676s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:05 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41 Apr 29 09:18:05 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:05 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-74c2c60b-9489-488f-97ab-4d4b9c52cc41" returned: 0 in 0.579s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-74c2c60b-9489-488f-97ab-4d4b9c52cc41" released by "delete_volume" :: held 1.296s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created reservations ['8bf55200-de6e-480c-bcde-578073287ed2', 'c021de46-e7f7-4d89-a13f-193938b32aba', '4f521ff4-c68c-4507-89b7-3ff70db40657', '6f0858ad-51a5-41c0-a525-e2f153be2e38'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:18:05 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:05 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:18:05 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:06 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.563s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:18:06 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Deleted volume successfully. Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-ddb0d620-bc4a-482f-90f5-5b1a1dd2bfc4 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-74c2c60b-9489-488f-97ab-4d4b9c52cc41-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-5d5062d1-2a49-4359-8776-4b667c73513e-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-5d5062d1-2a49-4359-8776-4b667c73513e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-quobyte-5d5062d1-2a49-4359-8776-4b667c73513e" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-5d5062d1-2a49-4359-8776-4b667c73513e" acquired by "delete_volume" :: waited 0.017s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb4c0f2-cb37-44d1-aa65-aec61c2f1b7c]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:18:06 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:06 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e Apr 29 09:18:06 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:07 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e" returned: 0 in 0.686s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:07 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e Apr 29 09:18:07 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:07 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:07 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-5d5062d1-2a49-4359-8776-4b667c73513e" returned: 0 in 0.565s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:07 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-5d5062d1-2a49-4359-8776-4b667c73513e" released by "delete_volume" :: held 1.290s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created reservations ['49a2177f-a195-46f3-a0bc-75e2858f5f48', '503535bf-e800-4e56-b480-bd3ec80d14a1', '04c184bc-e157-4243-ae47-d13f5d620e4d', 'f593e870-5bee-4ad4-a6cb-1662f927c3ee'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:08 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:18:08 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:08 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.563s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:18:08 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Deleted volume successfully. Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-b6f2f311-3646-48ac-bb63-3d981511e6a8 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-5d5062d1-2a49-4359-8776-4b667c73513e-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-92471916-7e95-487d-abf9-cf17d1166baa-delete_volume" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-92471916-7e95-487d-abf9-cf17d1166baa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "cinder-quobyte-92471916-7e95-487d-abf9-cf17d1166baa" by "delete_volume" {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-92471916-7e95-487d-abf9-cf17d1166baa" acquired by "delete_volume" :: waited 0.014s {{(pid=84004) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a978b5a-4aa2-4557-85f4-9fcc21cbf55a]: (4, 'qcow2') {{(pid=84972) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 09:18:08 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:09 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa Apr 29 09:18:09 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:09 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa" returned: 0 in 0.656s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:09 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:09 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa Apr 29 09:18:09 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:10 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4/volume-92471916-7e95-487d-abf9-cf17d1166baa" returned: 0 in 0.572s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-quobyte-92471916-7e95-487d-abf9-cf17d1166baa" released by "delete_volume" :: held 1.264s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG cinder.quota [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Created reservations ['1d44aeaa-7586-4dd9-8ce1-142d31e21d0b', 'ea871227-9672-4e2a-9128-f456fa917d49', '182601c1-8f00-44b5-bc9b-a698de253fed', '67982934-ca0c-4a80-b303-7cdc54339c25'] {{(pid=84004) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce': None} {{(pid=84004) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG cinder.volume.drivers.quobyte [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad176eb0-a049-4f77-9156-07408f8950ce'] {{(pid=84004) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.lockutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84004) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 09:18:10 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4 Apr 29 09:18:10 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 09:18:10 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG oslo_concurrency.processutils [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/17a605da42a702c36b934ebd3ea673c4" returned: 0 in 0.551s {{(pid=84004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG cinder.manager [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Notifying Schedulers of capabilities ... {{(pid=84004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 09:18:10 devstack cinder-volume[84004]: INFO cinder.volume.manager [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Deleted volume successfully. Apr 29 09:18:10 devstack cinder-volume[84004]: DEBUG cinder.coordination [None req-558ccff6-b38d-4518-a6c4-5b2878911f33 tempest-CreateVolumesFromSourceVolumeTest-1257076127 None] Lock "cinder-92471916-7e95-487d-abf9-cf17d1166baa-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=84004) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 09:18:20 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=90,cinder:INSERT=36,cinder:UPDATE=134,cinder:DELETE=12 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 09:18:20 devstack cinder-volume[84004]: DEBUG dbcounter [-] [84004] Writing DB stats cinder:SELECT=93,cinder:UPDATE=141,cinder:INSERT=34,cinder:DELETE=9 {{(pid=84004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}